Website link detection method and system

A website link and detection method technology, which is applied in the field of network security, can solve problems such as low efficiency, poor effectiveness, and dependence on manual operations, and achieve high detection efficiency and high capture rate.

Pending Publication Date: 2021-10-15
MICRO DREAM TECHTRONIC NETWORK TECH CHINACO
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of realizing the present invention, the applicant found that there are at least the following problems in the prior art: on the one hand, this method relies heavily on manual operations;

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Website link detection method and system
  • Website link detection method and system
  • Website link detection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0021] Such as figure 1 As shown, in combination with the embodiments of the present invention, a website link detection method is provided, including:

[0022] S101: Obtain the external links published in the platform, and request the crawler control service to crawl the webpage content corresponding to the external links;

[0023] S102: After the crawler control service receives the request for grabbing the web page content corresponding to the external lin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a website link detection method and system. The website link detection method comprises the steps that an external website link published in a platform is obtained, and webpage content corresponding to the external website link is requested to be grabbed; the crawler control service searches for an available crawler program entity Agent and requests to capture webpage content corresponding to the foreign site link; the available crawler Agent camouflages the information of the browser and the IP address of the available crawler Agent; after all webpage contents corresponding to the external website link are captured, returning the webpage contents and screenshots of the webpage contents to the crawler control service; and the content detection stream node detects whether the foreign site link is a legal link or not according to the keyword of the webpage content in the html form and / or the screenshot of the webpage content displayed in the browser. The external station link can be detected in real time, and the capturing rate of the external station link is high, so that normal release of the legal external station link can be ensured, and the detection efficiency is high.

Description

technical field [0001] The invention relates to the field of network security, in particular to a website link detection method and system. Background technique [0002] At present, the external link detection of the website mainly uses manual detection + whitelist mechanism, manually screens and reviews domain names and adds them to the whitelist, and performs operations such as filtering and blocking website links that are not within the scope of the whitelist. [0003] In the process of realizing the present invention, the applicant found that there are at least the following problems in the prior art: on the one hand, this method relies heavily on manual operations, on the other hand, it has poor effectiveness, and it is difficult for legitimate websites to pass the inspection, so the efficiency is low. Contents of the invention [0004] Embodiments of the present invention provide a website link detection method and system, which can detect external links in real time...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/951
CPCG06F16/951
Inventor 周源仇立杰焦裕波贾晓捷王佳佳魏灵峰虞子晗
Owner MICRO DREAM TECHTRONIC NETWORK TECH CHINACO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap