Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for enhancing recognition performance of anti-crawling system and storage medium

A system identification and performance technology, applied in the Internet field, can solve problems such as difficult and effective identification

Active Publication Date: 2019-04-05
上海两心科技有限公司
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the anti-crawling system based on expert knowledge has a certain performance in identifying crawlers, and the technology of crawlers is constantly developing. For new crawlers, the anti-crawling system may be difficult to effectively identify

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for enhancing recognition performance of anti-crawling system and storage medium
  • Method and device for enhancing recognition performance of anti-crawling system and storage medium
  • Method and device for enhancing recognition performance of anti-crawling system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] Specific embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

[0063] figure 1 is a flow chart of a method for enhancing the identification performance of an anti-climbing system according to an exemplary embodiment, as shown in figure 1 As shown, the method includes:

[0064] S11, using the anti-crawling system established based on supervised learning to identify the currently accessed data, so as to obtain the first crawler data and user data.

[0065] S12. Perform cluster analysis on the user data based on a clustering algorithm to obtain cluster data.

[0066] S13, updating the second crawler data to the training data of the anti-crawling system, so that the anti-crawling system performs training according to the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method and device for enhancing anti-crawling system recognition performance and a storage medium, and the method comprises the steps: carrying out the recognition of current access data through an anti-crawling system established based on supervised learning, so as to obtain first crawler data and user data; Performing clustering analysis on the user data based on a clustering algorithm to obtain cluster data; And updating second crawler data to the training data of the anti-crawling system, so that the anti-crawling system carries out training according to the updated training data, and the second crawler data is obtained by manually labeling the cluster data. The technical problem that in the prior art, it is difficult for an anti-crawling system to effectively identify newly appearing crawlers is solved.

Description

technical field [0001] The present disclosure relates to the technical field of the Internet, in particular, to a method, device and storage medium for enhancing the identification performance of an anti-climbing system. Background technique [0002] A crawler is a program or script that automatically grabs information on the Internet according to certain rules. Crawlers can help staff quickly obtain a large amount of data on the network, but some malicious crawlers may violate user privacy, or increase the load on the server to affect its normal service, so it is necessary to establish an anti-crawler system to prevent the use of malicious crawlers . [0003] In related technologies, features are extracted based on user behavior, and the difference between malicious crawler samples and normal samples is analyzed, and an anti-crawling system is established to shield crawlers by relying on expert knowledge design rules. However, the anti-crawling system established based on...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/951G06K9/62
CPCG06F18/23
Inventor 陈欢陈振
Owner 上海两心科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com