Webpage data acquisition method, intelligent terminal and storage medium

Abstract

The invention discloses a webpage data acquisition method, an intelligent terminal and a storage medium, and the method comprises the steps of receiving a request for accessing Nginx, and forwarding the request for accessing Nginx to a third-party web system of a proxy; when Nginx configuration is carried out, modifying the default user of the Nginx into the user with the highest authority in thelinux operating system or modifying the captured file directory owner into the default user of the Nginx; setting a request cache, and adding a cache with a preset size in the http section configuredby the Nginx according to an actual demand so as to obtain a file flow in the request; and obtaining the data and a file stream in the request through an Nginx script language, and converting the filestream into a file to be stored locally. According to the present invention, the Nginx is used for replacing the target application so as to intercept the data for analysis, and the target application does not need to provide any API interface or other adaptation operations, so that the problem of data acquisition for integrating a third-party application, especially providing no API interface, is effectively solved.

Description

technical field [0001] The invention relates to the field of computer application technology, in particular to a method for acquiring web page data, an intelligent terminal and a storage medium. Background technique [0002] When the development platform integrates third-party web systems, there are generally two integration solutions, one is API interface (Application Programming Interface, application programming interface) integration, and the other is the use of iframe (a page nesting frame) embedded Set of page integration methods. [0003] When obtaining third-party web system data, the current existing technology only focuses on the API interface integration method. The process is: the server first obtains the data stream of the target API, and then according to the preset interface information and the corresponding relationship between the fields of the data stream, in the The interface information of the target API is extracted from a specific field in the data flo...

AI Technical Summary

Problems solved by technology

[0006] The main purpose of the present invention is to provide a method for obtaining webpage data, an intelligent terminal and a storage medium, aiming at intercepting data for analysis through Nginx as a proxy target application, without providing any API interface or other adaptation operations by the target application, effectively solving the problem of integration Third-party applications, especially data acquisition problems that do not provide API interfaces

Images