A public opinion monitoring system based on consumer behavior

Abstract

The present invention discloses a public opinion monitoring system based on consumer behavior, which belongs to the technical field of public opinion monitoring. The system comprises an acquisition module that acquires network public opinion information in real time and transmits the acquired public opinion information to a central processing unit in real time; a preprocessing module that preprocesses the public opinion information, filters out useless information, and extracts keyword information to form a complete and ordered data set, providing available data to be analyzed for a subsequent public opinion analysis module; the public opinion analysis module is used to receive the preprocessed public opinion data, compare it with preset keyword information, calculate keyword category information appearing in the public opinion data, judge the positive and negative categories of the public opinion, and calculate the frequency information, distributed web page information and phased development trend of the negative public opinion, and send the analysis results to a management terminal to provide a basis for the management personnel's decision-making; the management terminal is used for the administrator to adjust the system data, change the system account authority, and view and process the public opinion analysis results.

Description

Technical Field

[0001] The present invention relates to the technical field of public opinion monitoring, and in particular to a public opinion monitoring system based on consumer behavior. Background Art

[0002] With the development of the internet, its role as a means of information dissemination has become deeply embedded in people's lives, and the dynamic nature of online discourse is immeasurable. Even major events can generate online public opinion, which can be expressed and disseminated online, generating pressure. The internet has become an amplifier of public opinion, reaching a level that no department or organization can ignore. Internet public opinion is the influential and biased expression of opinions and views on real-life hot topics and focal points, expressed through forums, blogs, Weibo, news feeds, and other platforms. If not properly guided, negative public opinion can ensue, posing a threat to social security. Current public opinion monitoring efforts simply filter out all occurrences of sensitive terms, effectively prohibiting their presence. This overly restrictive approach can also negatively impact the dissemination of positive information. Furthermore, it fails to analyze the distribution and trends of public opinion, hindering long-term improvement and resolution. Summary of the Invention

[0003] In view of the above-mentioned technical deficiencies, the purpose of the present invention is to provide a public opinion monitoring system based on consumer behavior.

[0004] To solve the above technical problems, the present invention adopts the following technical solution: The present invention provides a public opinion monitoring system based on consumer behavior, comprising:

[0005] A collection module, which collects online public opinion information in real time and transmits the collected public opinion information to the central processing unit in real time;

[0006] A preprocessing module, which preprocesses public opinion information, filters useless information, and extracts keyword information to form a complete and ordered data set, providing usable data for analysis by the subsequent public opinion analysis module;

[0007] The public opinion analysis module is used to receive pre-processed public opinion data, compare it with preset keyword information, calculate the keyword category information appearing in the public opinion data, determine the positive and negative categories of public opinion, and calculate the frequency information, distributed web page information and stage development trend of negative public opinion. The analysis results are sent to the management terminal to provide a basis for the management personnel's decision-making;

[0008] An alarm module is used to send an alarm message to the management terminal when the negative public opinion level exceeds a preset threshold, so that the management personnel can view the analysis results in time and deal with the public opinion;

[0009] Management terminal, which is used by administrators to adjust system data, change system account permissions, and view and process public opinion analysis results;

[0010] A storage module, wherein the storage module is used to store system operation data;

[0011] The central processing unit is used to coordinate the work of the above modules, to call corresponding data in each database within its authority through data call commands, and to send these control commands to the corresponding modules.

[0012] Furthermore, the collection module includes a crawler unit, a retrieval unit and a transmission unit. The crawler unit is used to crawl consumer behavior data from various e-commerce platforms and social platforms, and to crawl public opinion information of hot news from the Internet; the retrieval unit is used to retrieve consumer information on e-commerce platforms and social platforms, as well as Internet IP information; the transmission unit is used to transmit the data information collected by the crawler unit and the retrieval unit in real time.

[0013] Furthermore, when crawling data information, the crawler unit also obtains the article ID of the public opinion data as a unique identifier to distinguish the public opinion information; the consumer information includes the name, gender and age information of the consumer account.

[0014] Furthermore, the pre-processing module includes a text processing unit, a web page parsing unit, an information extraction unit and an information filtering unit, wherein:

[0015] The text processing unit is used to process the crawled text data after receiving it, determine the keyword category in the crawled data, and compare it with the preset public opinion sensitive words, and transmit the comparison results to the information extraction unit and the information filtering unit;

[0016] The information filtering unit is used to filter the crawled data that is not related to public opinion sensitive words after comparison;

[0017] The information extraction unit is used to extract and classify keywords that overlap with public opinion sensitive words;

[0018] The web page parsing unit is used to parse the IP location of the web page where the extracted and classified keywords are located, and obtain the public opinion text and intelligent summary in the web page, so as to facilitate the public opinion analysis module to locate the information with excessive public opinion level during analysis, and facilitate subsequent processing.

[0019] Furthermore, the keyword categories include politics, emotions, education and social hot spots.

[0020] Furthermore, the public opinion analysis module includes public opinion category analysis, public opinion level analysis, public opinion distribution analysis and development trend analysis, wherein:

[0021] The public opinion category analysis is used to extract the evaluation words from the public opinion text and summary provided by the web page analysis unit, so as to determine whether the public opinion is positive or negative;

[0022] The public opinion level analysis is used to calculate the frequency of negative public opinion and determine the harm level of the public opinion article based on a preset threshold;

[0023] The public opinion distribution analysis is used to establish a public opinion distribution model based on the public opinion level analysis results and the corresponding web page IP addresses, determine the public opinion situation on each platform and website, and provide evaluation criteria for subsequent processing of each platform and website;

[0024] The development trend analysis is used to establish a relationship diagram between public opinion level and development time, predict subsequent public opinion development trends, and provide a reference for handling measures.

[0025] Furthermore, the public opinion category is determined by subject detection, hot topic extraction, sensitive topic identification, and praise and criticism analysis; the calculation method in the public opinion level analysis is Where n is the total number of sensitive words appearing on web pages, A i is the weight of the sensitive word appearing on the i-th web page, B i is the response rate of the public opinion keyword on the i-th web page.

[0026] Furthermore, the management terminal includes keyword management, authority management and manual processing. The keyword management is used by management personnel to update and delete the keyword database entered into the system, so as to facilitate the monitoring of public opinion on different topics; the authority management is used to update the account authority of system review personnel; the manual processing is used to process public opinion, including public opinion deletion, platform and website closure penalties.

[0027] The beneficial effects of the present invention are: the present invention collects information from various platforms and websites in real time through the collection module, extracts public opinion information and the corresponding platform and website IP, public opinion text, and intelligent summary through the preprocessing module to form a complete and orderly data set, thereby quickly analyzing whether the public opinion is positive or negative, and calculating the frequency information of negative public opinion through public opinion level analysis, and determining the hazard level of the public opinion article according to the preset threshold. The public opinion distribution analysis establishes a public opinion distribution model based on the public opinion level analysis results and the corresponding web page IP address, determines the occurrence of public opinion on various platforms and websites, and provides evaluation standards for subsequent processing of various platforms and websites. The analysis results are delivered to the management terminal, and the public opinion hazard alarm is sent to the management terminal through the alarm module, which is convenient for timely processing and control of public opinion development, realizing public opinion monitoring and rapid response, and avoiding the impact of the rampant negative public opinion. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0029] Figure 1 A schematic diagram of a public opinion monitoring system based on consumer behavior provided by an embodiment of the present invention.

[0030] Figure 2 Schematic diagram of the acquisition module of the present invention.

[0031] Figure 3 Schematic diagram of the preprocessing module of the present invention.

[0032] Figure 4 Schematic diagram of the public opinion analysis module of the present invention.

[0033] Figure 5 This is a schematic diagram of the management terminal of the present invention. DETAILED DESCRIPTION

[0034] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0035] Example: Figures 1 to 5 As shown, the present invention provides a public opinion monitoring system based on consumer behavior, comprising:

[0036] The collection module collects online public opinion information in real time and transmits the collected public opinion information to the central processing unit in real time;

[0037] The preprocessing module preprocesses public opinion information, filters out useless information, and extracts keyword information to form a complete and orderly data set, providing usable data for analysis in the subsequent public opinion analysis module;

[0038] The public opinion analysis module is used to receive pre-processed public opinion data, compare it with preset keyword information, calculate the keyword category information appearing in the public opinion data, determine the positive and negative categories of public opinion, and calculate the frequency information, distributed web page information and stage development trend of negative public opinion. The analysis results are sent to the management terminal to provide a basis for management personnel's decision-making;

[0039] The alarm module is used to send an alarm message to the management terminal when the negative public opinion level exceeds the preset threshold, so that the management personnel can view the analysis results in time and deal with the public opinion;

[0040] Management terminal: The management terminal is used by administrators to adjust system data, change system account permissions, and view and process public opinion analysis results;

[0041] Storage module, the storage module is used to store system operation data;

[0042] The central processing unit is used to coordinate the work of the above modules, use data call commands to call corresponding data in each database within its authority, and send these control commands to the corresponding modules.

[0043] Furthermore, the collection module includes a crawler unit, a retrieval unit and a transmission unit. The crawler unit is used to crawl consumer behavior data from various e-commerce platforms and social platforms, and to crawl public opinion information of hot news from the Internet; the retrieval unit is used to retrieve consumer information on e-commerce platforms and social platforms, as well as Internet IP information; the transmission unit is used to transmit the data information collected by the crawler unit and the retrieval unit in real time.

[0044] Furthermore, when crawling data information, the crawler unit also obtains the article ID of the public opinion data as a unique identifier to distinguish the public opinion information; consumer information includes the name, gender and age information of the consumer account.

[0045] Furthermore, the pre-processing module includes a text processing unit, a web page parsing unit, an information extraction unit and an information filtering unit, wherein:

[0046] The text processing unit is used to process the crawled text data after receiving it, determine the keyword category in the crawled data, and compare it with the preset public opinion sensitive words, and transmit the comparison results to the information extraction unit and the information filtering unit;

[0047] The information filtering unit is used to filter the crawled data that is not related to public opinion sensitive words after comparison;

[0048] The information extraction unit is used to extract and classify keywords that overlap with public opinion sensitive words;

[0049] The web page parsing unit is used to parse the IP location of the web page where the extracted and classified keywords are located, and to obtain the public opinion text and intelligent summary in the web page, so as to facilitate the public opinion analysis module to locate the information with excessive public opinion level during analysis, and facilitate subsequent processing.

[0050] Furthermore, keyword classification includes politics, emotions, education and social hot spots.

[0051] Furthermore, the public opinion analysis module includes public opinion category analysis, public opinion level analysis, public opinion distribution analysis and development trend analysis, among which,

[0052] Public opinion category analysis is used to extract evaluation words from the public opinion text and intelligent summary provided by the web page analysis unit, thereby determining whether the public opinion is positive or negative;

[0053] Public opinion level analysis is used to calculate the frequency of negative public opinion and determine the harm level of public opinion articles based on preset thresholds;

[0054] Public opinion distribution analysis is used to establish a public opinion distribution model based on the public opinion level analysis results and the corresponding web page IP addresses, determine the occurrence of public opinion on various platforms and websites, and provide evaluation criteria for subsequent processing of each platform and website;

[0055] Development trend analysis is used to establish a relationship diagram between public opinion levels and development time, predict subsequent public opinion development trends, and provide a reference for handling measures.

[0056] Furthermore, the public opinion category is determined by subject detection, hot topic extraction, sensitive topic identification, and praise and criticism analysis; the calculation method in the public opinion level analysis is Where n is the total number of sensitive words appearing on web pages, A i is the weight of the sensitive word appearing on the i-th web page, B i is the response rate of the public opinion keyword on the i-th web page.

[0057] When in use, the crawler unit is used to crawl consumer behavior data from various e-commerce platforms and social platforms, as well as public opinion information for hot news from the Internet. At the same time, the retrieval unit is used to retrieve consumer information on e-commerce platforms and social platforms, as well as Internet IP information. The collected data is then transmitted to the preprocessing module, which preprocesses the collected information, extracts public opinion information based on keywords, filters out useless articles and information, and uses web page analysis to match public opinion information with corresponding platforms and website IPs, public opinion texts, and intelligent summaries, forming a complete and orderly data set for easy analysis and processing, and then classifies the data into categories based on public opinion. The analysis is based on the public opinion text and intelligent summary provided by the web page analysis unit, and the evaluation words are extracted to determine whether the public opinion is positive or negative. The frequency information of negative public opinion is calculated through public opinion level analysis, and the hazard level of the public opinion article is determined according to the preset threshold. The public opinion distribution analysis establishes a public opinion distribution model based on the public opinion level analysis results and the corresponding web page IP address, determines the occurrence of public opinion on each platform and URL, and provides evaluation standards for the subsequent processing of each platform and URL. The analysis results are transmitted to the management terminal, and the public opinion hazard alarm is sent to the management terminal through the alarm module to facilitate timely processing and control of the development of public opinion.

[0058] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A public opinion monitoring system based on consumer behavior, characterized by: include: A collection module, which collects online public opinion information in real time and transmits the collected public opinion information to the central processing unit in real time; A preprocessing module, which preprocesses public opinion information, filters useless information, and extracts keyword information to form a complete and ordered data set, providing usable data for analysis by the subsequent public opinion analysis module; The public opinion analysis module is used to receive pre-processed public opinion data, compare it with preset keyword information, calculate the keyword category information appearing in the public opinion data, determine the positive and negative categories of public opinion, and calculate the frequency information, distributed web page information and stage development trend of negative public opinion. The analysis results are sent to the management terminal to provide a basis for the management personnel's decision-making; An alarm module is used to send an alarm message to the management terminal when the negative public opinion level exceeds a preset threshold, so that the management personnel can view the analysis results in time and deal with the public opinion; Management terminal, which is used by administrators to adjust system data, change system account permissions, and view and process public opinion analysis results; A storage module, wherein the storage module is used to store system operation data; The central processing unit is used to coordinate the work of the above modules, to call corresponding data in each database within its authority through data call commands, and to send these control commands to the corresponding modules; The public opinion analysis module includes public opinion category analysis, public opinion level analysis, public opinion distribution analysis and development trend analysis, among which, The public opinion category analysis is used to extract the evaluation words from the public opinion text and summary provided by the web page analysis unit, so as to determine whether the public opinion is positive or negative; The public opinion level analysis is used to calculate the frequency of negative public opinion and determine the harm level of the public opinion article based on a preset threshold; The public opinion distribution analysis is used to establish a public opinion distribution model based on the public opinion level analysis results and the corresponding web page IP addresses, determine the public opinion situation on each platform and website, and provide evaluation criteria for subsequent processing of each platform and website; The development trend analysis is used to establish a relationship diagram between public opinion level and development time, predict subsequent public opinion development trends, and provide reference for handling measures; The public opinion category is determined by subject detection, hot topic extraction, sensitive topic identification, and praise and criticism analysis; the calculation method in the public opinion level analysis is sensitive word frequency × , where n is the total number of sensitive words appearing on web pages, A i is the weight of the sensitive word appearing on the i-th web page, B i is the response rate of the public opinion keyword on the i-th web page.

2. The consumer behavior-based public opinion monitoring system according to claim 1, characterized in that: The collection module includes a crawler unit, a retrieval unit, and a transmission unit. The crawler unit is used to crawl consumer behavior data from various e-commerce platforms and social platforms, and to crawl public opinion information of hot news from the Internet; the retrieval unit is used to retrieve consumer information from e-commerce platforms and social platforms, as well as Internet IP information; The transmission unit is used to transmit the data information collected by the crawler unit and the retrieval unit in real time.

3. The consumer behavior-based public opinion monitoring system according to claim 2, characterized in that: When crawling data information, the crawler unit also obtains the article ID of the public opinion data as a unique identifier to distinguish the public opinion information; the consumer information includes the name, gender and age information of the consumer account.

4. The consumer behavior-based public opinion monitoring system according to claim 1, characterized in that: The pre-processing module includes a text processing unit, a web page parsing unit, an information extraction unit and an information filtering unit, wherein: The text processing unit is used to process the crawled text data after receiving it, determine the keyword category in the crawled data, and compare it with the preset public opinion sensitive words, and transmit the comparison results to the information extraction unit and the information filtering unit; The information filtering unit is used to filter the crawled data that is not related to public opinion sensitive words after comparison; The information extraction unit is used to extract and classify keywords that overlap with public opinion sensitive words; The web page parsing unit is used to parse the IP location of the web page where the extracted and classified keywords are located, and obtain the public opinion text and intelligent summary in the web page, so as to facilitate the public opinion analysis module to locate the information with excessive public opinion level during analysis, and facilitate subsequent processing.

5. The consumer behavior-based public opinion monitoring system according to claim 4, characterized in that: Keyword categories include politics, emotions, education and social hot topics.

6. The consumer behavior-based public opinion monitoring system according to claim 1, characterized in that: The management terminal includes keyword management, authority management and manual processing. The keyword management is used by managers to update and delete the keyword database entered by the system, which is convenient for monitoring public opinion on different topics; The permission management is used to update the account permissions of system review personnel; the manual processing is used to handle public opinion, including public opinion deletion, platform and website closure penalties.

Images