Method and system for collecting project list of internet financial webpage

A project list, Internet technology, applied in the field of project list collection of Internet financial web pages, can solve the problems of low data collection efficiency, time-consuming and laborious script writing, and achieve the effect of simplifying script configuration and improving data collection efficiency.

Pending Publication Date: 2020-04-21
NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT +1
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to solve the technical problem of time-consuming and labor-intensive script writing work in the prior art, resulting in low efficiency of data collection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for collecting project list of internet financial webpage
  • Method and system for collecting project list of internet financial webpage
  • Method and system for collecting project list of internet financial webpage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] refer to figure 1 , figure 1 It is a schematic flowchart of an embodiment of a method for collecting an item list of an Internet financial webpage according to the present invention. In one embodiment, the method for collecting the item list of the Internet financial webpage is applied to the system for collecting the item list of the Internet financial webpage, the system includes a generation end and an execution end, and the method includes:

[0045] Step S10, the script generation end displays a visual configuration interface corresponding to the Internet finance webpage;

[0046] In this embodiment, the visual configuration interface corresponding to the Internet finance webpage is used for the user to perform visual configuration, so as to generate a project list collection script corresponding to the Internet finance webpage according to the user's configuration operations on the interface.

[0047] In one embodiment, step S10 includes:

[0048] The script gen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and system for collecting a project list of an internet financial webpage. The method comprises that a script generation end displays a visual configuration interfacecorresponding to the internet financial webpage; the script generation end generates a project list collection script according to the configuration operation of the user on the visual configuration interface, and stores the project list collection script in a database; when the time reaches the execution time point of the project list acquisition script, the script generation end takes out the project list acquisition script from the database and puts the project list acquisition script into a task queue; the script generation end distributes the project list acquisition scripts in the task queue to the execution end; and the execution end runs the project list acquisition script to obtain project list acquisition information, and stores the project list acquisition information in a localfile system of the execution end. According to the method and the device, the script configuration work is greatly simplified through a visual configuration mode, so that the data acquisition efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and system for collecting item lists of Internet financial webpages. Background technique [0002] In the prior art, obtaining information from a webpage is generally implemented by means of a crawler script. But crawler scripts need to be written according to technical staff. But this method needs to analyze the web page organization form of the target website, the data interface and the Javascript logic code on the page, and write the corresponding program code or script to filter out specific data according to certain rules. That is, when it is necessary to crawl data from different web pages, it is necessary to write different crawler scripts, which is undoubtedly a huge workload for technicians, and script writing is time-consuming and laborious, resulting in low data collection efficiency. Contents of the invention [0003] The main purpose of the prese...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/30
CPCG06F8/30
Inventor 唐积强吴震施力杨菁林徐小磊李焱余胡晓光刘刚周洋
Owner NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap