WeChat article and official account acquisition method and acquisition system

A WeChat official account and acquisition method technology, applied in the field of data acquisition, to achieve the effect of comprehensive crawling and good usability

Active Publication Date: 2016-02-10
TSINGHUA UNIV
View PDF5 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in WeChat data acquisition, there is no efficient, stable and comprehensive technical solution to acquire WeChat articles and official accounts

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • WeChat article and official account acquisition method and acquisition system
  • WeChat article and official account acquisition method and acquisition system
  • WeChat article and official account acquisition method and acquisition system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but should not be used to limit the scope of the present invention.

[0044] A method for obtaining WeChat articles and official accounts, such as Figure 1A , 1B As shown, the method includes the following steps:

[0045] S1. Obtain the keywords required for WeChat retrieval. For each keyword, construct multiple search URLs for it, and put the constructed search URLs into the request queue; wherein the search URL refers to searching the WeChat article list by keywords URL.

[0046] S2, start the crawler component, and crawl for each search URL of a keyword and the uncrawled URL on the search URL page:

[0047] S21. Determine whether the currently crawled page is a verification code page, if the currently crawled page is a verification code page, then perform step S22, otherwi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a WeChat article and official account acquisition method and acquisition system. According to the acquisition method and acquisition system, a third party is accessed to identify an authentication code based on normal crawling of a crawler, and thus a problem of the authentication code occurring when Sogou performs a search is solved, and the crawler is ensured to stably crawl; besides,, the crawler performs a bloom filtration by using an article ID and an official account to ensure that the WeChat crawler can run normally despite of a change of the URL of a Sogou search platform, and a previous crawler updated state is recorded by a incremental list, so that incremental crawl of the crawler is ensured, and the efficiency of the crawler is improved. The Wechat official account and article can be crawled efficiently, stably and fully, and the acquisition method and acquisition system have excellent usability.

Description

technical field [0001] The invention belongs to the technical field of data acquisition, and more specifically relates to a method and system for acquiring WeChat articles and official accounts. Background technique [0002] According to the 2015 WeChat performance report released by Tencent, the monthly active users of WeChat have exceeded 500 million, covering more than 200 countries and more than 20 languages. In addition, WeChat public accounts are one of the main businesses of WeChat. In November 2013, the number of WeChat public accounts exceeded 2 million. In July 2014, the number of WeChat public accounts reached 5.8 million. In December 2014, the total number of WeChat public accounts exceeded 8 million. At present, the number of WeChat public accounts has exceeded 10 million. WeChat official accounts mainly increase the number of fans by pushing articles, so that advertisers can place advertisements on official accounts with high attention. According to statistics...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/951
Inventor 薛一波易成岐郭泽豪
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap