Unlock instant, AI-driven research and patent intelligence for your innovation.

Public opinion data acquisition method and system based on RPA

A technology of data acquisition and public opinion, applied in the field of data processing, can solve the problems of low accuracy and low efficiency of public opinion data collection, and achieve the effect of improving work efficiency and accuracy

Active Publication Date: 2021-09-28
广州越创智数信息科技有限公司
View PDF10 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides an RPA-based public opinion data acquisition method and an RPA-based public opinion data acquisition system to solve the problems of low accuracy and low efficiency of public opinion data collection described in the prior art.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Public opinion data acquisition method and system based on RPA
  • Public opinion data acquisition method and system based on RPA
  • Public opinion data acquisition method and system based on RPA

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] This embodiment proposes a method for obtaining public opinion data based on RPA, such as figure 1Shown is a flow chart of the method for acquiring public opinion data based on RPA in this embodiment.

[0050] In the method for obtaining public opinion data based on RPA that this embodiment proposes, comprise the following steps:

[0051] Step 1: Obtain the target address data list, traverse each piece of data in the target address data list, perform webpage access through RPA, and jump to the target page.

[0052] In this embodiment, the target address data list is input by the user, or obtained by reading from a database, wherein the target address data list in this embodiment includes a webpage address and a shop id.

[0053] Step 2: intercept the public opinion data picture in the target page according to the preset public opinion data sub-elements.

[0054] The public opinion data sub-elements in this embodiment include user comments, user ratings, number of repl...

Embodiment 2

[0088] This embodiment proposes an RPA-based public opinion data acquisition system, such as figure 2 Shown is the architecture diagram of the RPA-based public opinion data acquisition system of this embodiment.

[0089] In the public opinion data acquisition system based on RPA that this embodiment proposes, comprise RPA module 1, picture interception module 2, OCR data recognition module 3, data caching module 4 and database 5, wherein:

[0090] RPA module 1 is used to traverse the input target address data list to perform webpage access and jump to the target page;

[0091] The picture intercepting module 2 is used to intercept the public opinion data picture in the target page according to the preset public opinion data sub-elements, and send it to the OCR data identification module 3; wherein, the preset public opinion data sub-elements include user comments, user ratings, replies number and the id of the div tag;

[0092] The OCR data identification module 3 is used f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

In order to solve the problems of low public opinion data acquisition accuracy and low efficiency, the invention provides a public opinion data acquisition method and system based on RPA, and the public opinion data acquisition method comprises the following steps: acquiring a target address data list, traversing each piece of data in the target address data list, and performing webpage access through RPA, skipping to a target page; intercepting a public opinion data picture in the target page according to preset public opinion data sub-elements; performing character recognition on the public opinion data pictures based on an OCR technology, and caching the public opinion data pictures in corresponding tables according to categories of the public opinion data; and after each piece of data in the target address data list is traversed, writing the table into a database for storage. According to the method and system, the RPA and OCR technologies are combined to obtain the public opinion data from the website carrying the CSS anti-crawling mechanism, and the working efficiency and accuracy of public opinion data obtaining are effectively improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to an RPA-based public opinion data acquisition method and system. Background technique [0002] RPA (Robotic Process Automation) technology is used to help various departments of enterprises to effectively automate business processes and replace human labor to perform highly repetitive but logical tasks. For example, a smart data analysis platform based on intelligent data collection and analysis proposed by the publication number CN112256770A (public date 2021-01-22) proposes to use the RPA data collection and analysis module to simulate the manual operation process and carry out standardized work. Collect marketing, user acquisition and PMS2.0 business data in the system, and then analyze them. [0003] However, since most websites currently have a strict CSS anti-climbing mechanism, when RPA technology is used for public opinion data collection, there a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/951G06F16/953G06K9/32
CPCG06F16/951G06F16/953
Inventor 梁嘉妍陈磊吕理强冯明煜李羡童刘佳侯美伦
Owner 广州越创智数信息科技有限公司