Unlock instant, AI-driven research and patent intelligence for your innovation.

Information crawling method, device, electronic equipment and system

An electronic device, WeChat technology, applied in the field of Internet communication, can solve the problems of limited number of articles, low efficiency, and inability to obtain articles, and achieve the effect of improving performance and efficiency

Inactive Publication Date: 2018-04-20
福建中金在线信息科技有限公司
View PDF9 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the existing WeChat official account crawlers crawl through Sogou to search WeChat official accounts, which is inefficient, and Sogou search has strict anti-crawling rules, and cannot obtain a large number of official account articles in a short period of time. There is also a limit to the number of articles on the WeChat public account

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Information crawling method, device, electronic equipment and system
  • Information crawling method, device, electronic equipment and system
  • Information crawling method, device, electronic equipment and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] This embodiment provides an information crawling method, which is applied to an electronic device set between a WeChat client and a WeChat server, and used for crawling content in a WeChat official account. figure 1 A flow chart of the information crawling method provided by this embodiment is shown. Such as figure 1 As shown, the method includes the following steps:

[0040] Step S101, when receiving a WeChat official account access request sent by a WeChat client, extract the link address and the WeChat official account identifier carried in the access request.

[0041] In this embodiment, the WeChat client needs the above-mentioned electronic device as an intermediate device to connect with the WeChat server. The electronic device may also be called a proxy server. When a WeChat client follows a certain WeChat official account or views a certain article in a certain WeChat official account, it needs to send a WeChat official account access request. After the acces...

Embodiment 2

[0061] Corresponding to the method embodiment, this embodiment provides an information crawling device, which is applied to an electronic device installed between a WeChat client and a WeChat server, and used to crawl content in a WeChat official account. image 3 A structural block diagram of the information crawling device provided by this embodiment is shown. Such as image 3 As shown, the device includes:

[0062] The link address acquisition unit 31 is used to extract the link address and the WeChat official account identification carried by the access request when receiving the WeChat official account access request sent by the WeChat client;

[0063] A link request sending unit 32, configured to send a link request to the WeChat server corresponding to the link address; the link request includes the WeChat official account identification;

[0064] The request address sending unit 33 is used to receive the network request address corresponding to the WeChat public acco...

Embodiment 3

[0070] This embodiment provides an electronic device. The electronic device includes a processor and memory.

[0071] The memory is used to store software program modules for execution by the processor. The processor is configured to execute the method described in Embodiment 1 above. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.

[0072] Further, the above-mentioned software program modules may further include: an operating system and a service module. Wherein the operating system, for example, can be LINUX, UNIX, WINDOWS, which can include various software components and / or drivers for managing system tasks (such as memory management, storage device control, power management, etc.), and can communicate with various hardware Or software components communicate with each other to provide an operating environment for other s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an information crawling method, device, electronic equipment and system, and belongs to the technical field of the internet communication. Through the information crawling method, device, electronic equipment and system provided by the embodiment of the invention, the electronic equipment is arranged between a Wechat client and a Wechat server to acquire a network request address provided by the Wechat server to provide for a network crawling unit; the network crawling unit crawls the data and information in a Wechat Official account, all articles in the Wechat officialaccount can be acquired, so that a crawling program can acquire a large number of content of the Wechat official account in short time, and the performance and the efficiency of the crawling program are greatly improved.

Description

technical field [0001] The present invention relates to the technical field of Internet communication, in particular, to an information crawling method, device, electronic equipment and system. Background technique [0002] At present, there are two ways to view the articles in the WeChat official account: one is to view the articles of the official account through the search function of Sogou WeChat, and the other is to view the articles of the official account through the WeChat APP of the mobile phone. Most of the existing WeChat official account crawlers crawl through Sogou to search WeChat official accounts, which is inefficient, and Sogou search has strict anti-crawling rules, and cannot obtain a large number of official account articles in a short period of time. There is also a limit to the number of articles on the WeChat official account. Contents of the invention [0003] Aiming at the above-mentioned problems in the prior art, the present invention provides an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/58H04L29/08G06F17/30
CPCH04L51/04H04L67/14G06F16/951G06F16/9566H04L67/56
Inventor 沈文策
Owner 福建中金在线信息科技有限公司