Method and device for users to grasp external web pages in agent cloud environment
An external web page and cloud environment technology, applied in the Internet field, can solve problems such as many restrictions, not supporting user-defined requirements, not supporting https access, etc., to achieve the effect of convenient management and improved use efficiency
Active Publication Date: 2014-03-26
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] At present, it is very common to access an external web page or submit a request to an external address in the proxy cloud environment. Users can use the sdk (Software Development Kit, software development kit) provided by the FetchURL service (web crawling service provided by the cloud environment) ) to access external web pages, however, this access method has the following problems: (1) SDK has many restrictions and does not support user's custom requirements; (2) cannot audit the user's resources; (3) does not support https access
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. On the contrary, the embodiments of the present invention include all changes, modifications and equivalents coming within the spirit and scope of the appended claims.
[0023] In the description of the present invention, it should be understood that the terms "first", "second" and so on are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance. In the description of the present invention, it should be noted that unless otherwise specified and limited, the terms "connected" and "connect...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a method and device for users to grasp external web pages in agent cloud environment, wherein the method comprises the following steps: receiving a request for grasping a web page from a user; authenticating the user; counting the user quota so as to determine whether the user is on the blacklist or not; resolving the request so as to determine whether the user requires the use of http or https agreements to grasp web pages or not; if the user is authenticated and is not on the blacklist, using the http or https agreements to grasp the web page as requested on behalf of the user. According to the method provided by the embodiment of the invention, by using the user authentication and the quota blacklist identification in the agent cloud environment, users conforming to the authentication and the quota blacklist identification use the http or https agreements to grasp the web pages, so that the method not only meets the requirement that the users obtain external resources, but also counts the using resources of the users, so the management is convenient. The method limits the users with large resource usage,thereby increasing the service efficiency.
Description
technical field [0001] The invention relates to the technical field of the Internet, in particular to a method and a device for grabbing external webpages on behalf of users in a cloud environment. Background technique [0002] At present, it is very common to access an external web page or submit a request to an external address in the proxy cloud environment. Users can use the sdk (Software Development Kit, software development kit) provided by the FetchURL service (web crawling service provided by the cloud environment) ) to access external web pages, however, this access method has the following problems: (1) SDK has many restrictions and does not support user's custom requirements; (2) cannot audit the user's resources; (3) does not support https access. Contents of the invention [0003] The present invention aims to solve at least one of the above-mentioned technical problems. [0004] For this reason, an object of the present invention is to propose a method of p...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L29/06G06F17/30
Inventor 高巍何磊李彬孟
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD