Method and device for identifying search engine crawler, and method and device for processing search engine crawler
A search engine and crawler technology, applied in the field of crawler identification, can solve the problems of low accuracy and reliability, and achieve the effect of accurate and reliable identification
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0040] According to an embodiment of the present invention, an embodiment of a method for identifying search engine crawlers is provided. It should be noted that the steps shown in the flow charts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and , although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.
[0041] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Take running on a computer terminal as an example, figure 1 It is a hardware structure block diagram of a computer terminal of a search engine crawler identification method according to an embodiment of the present invention. Such as figure 1 As shown, the computer terminal 10 may include one or more (only one is shown in ...
Embodiment 2
[0076] According to an embodiment of the present invention, there is also provided a device for implementing the identification method of the above-mentioned search engine crawler, such as image 3 As shown, the device includes:
[0077] The obtaining module 30 is used to obtain statistical data obtained after the client visits multiple websites within each statistical time period of the statistical cycle, wherein the above-mentioned statistical time periods constitute the above-mentioned statistical cycle;
[0078] Here, the statistical cycle can be set according to the actual situation, for example, it can be set as one month or one quarter. The statistical time period can also be flexibly set according to the actual situation, such as 24 hours, 48 hours, etc.
[0079] In an optional implementation manner, statistics may be made on the number of websites visited by the client every day in a month. In an optional implementation manner, there are multiple specific implemen...
Embodiment 3
[0098] According to an embodiment of the present invention, an embodiment of a processing method for a search engine crawler is also provided. figure 1 run on the computer terminal. Figure 5 is a schematic diagram of a processing method for a search engine crawler according to an embodiment of the present invention. Such as Figure 5 As shown, the method includes the following processing steps:
[0099] Step S502, acquiring statistical data obtained after the client visits multiple websites within each statistical time period of the statistical period, wherein each statistical time period constitutes the statistical period;
[0100] Here, the statistical cycle can be set according to the actual situation, for example, it can be set as one month or one quarter. The statistical time period can also be flexibly set according to the actual situation, such as 24 hours, 48 hours, etc.
[0101] In an optional implementation manner, statistics may be made on the number of websi...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More