Anti-crawler method based on front-end and rear-end separation development

A front-end and back-end, anti-crawling technology, applied in the protection of internal/peripheral computer components, software design, etc., can solve the problems of easy collection by crawlers, leaking data information, etc., and achieve the effect of improving website security performance and user experience

Inactive Publication Date: 2019-12-13
SICHUAN CHANGHONG ELECTRIC CO LTD
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide an anti-crawler method based on the separation of front-end and back-end, which is used to solve the problem in the prior art that the back-end data is transmitted to the front-end for display and is easily collected by crawlers and leaks data information.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Anti-crawler method based on front-end and rear-end separation development
  • Anti-crawler method based on front-end and rear-end separation development

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] combined with figure 1 As shown, an anti-reptile method based on the separation of the front and rear ends, the method includes the following steps:

[0026] First, the front end determines the HTML webpage, and the source HTML webpage is the HTML webpage normally compiled by the website staff. The source HTML web page includes multiple tag structures, and each tag includes valid data that needs to be displayed to the user. Such as:

[0027] ......... and other page structure

[0028] Then, the back-end calls the interface to obtain data from the database, and transfers the data with HTML structure tag transfer characters, such as: {title:'";\u003Cdiv\u003E\u003Cdiv and Huawei promote the ultra-high-definition standard, and Changhong has three advantages'" ;\u003Cdiv\u003E\u003Cdivslice(6,-6),Content:'";\u003Cdiv\u003E\u003Cdivclass=;\";pgc-img\";\u003E\u003Cimgsrc=;\";http:\u002F\ u002Fp1.pstatp.com\u002Flarge\u002Fpgc-image\u002F0e8e39f761174f84b4d16418b0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an anti-crawler method based on front-end and rear-end separation development. The method comprises the following steps:1, a front end constructing a source HTML webpage whichcomprises normal data displayed to a user and a label structure containing protected data; 2, a rear-end program calling a service layer to run a service code to extract data needing to be displayed,and preprocessing the extracted data; and 3, performing front-end and rear-end interaction, using a JSON format for data transmission, and the front end decrypting the data after acquiring the data and then displaying the data on an HTML page.

Description

technical field [0001] The invention relates to the technical field of computer software, in particular, it is an anti-crawler method based on the separate development of the front and back ends. Background technique [0002] In recent years, the Internet has gradually shifted to the direction of big data. In the big data environment, data acquisition is very important. In the method of data acquisition, crawler technology is usually used for data capture. In order to protect one's own web page content in a big data environment, it is necessary to perform anti-crawling processing on crawlers. The struggle between crawling and anti-crawling has never stopped. The previous primary crawlers screened header information, and tested and improved the crawler program by constantly fighting against anti-crawling. After technological advancement, crawlers can: imitate human behavior, load Javascript and external resources, simulate cookies and useragent, automate browser operations,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/20G06F21/71
CPCG06F8/20G06F21/71
Inventor 李昌瀚
Owner SICHUAN CHANGHONG ELECTRIC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap