Webpage path navigation method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a webpage path navigation method and device, electronic equipment and a storage medium, and the webpage path navigation method comprises the steps: receivingan input request of a user; querying at least one access task corresponding to the input request from a pre-obtained access task set based on the input request, with the at least one access task comprising a webpage navigation sequence from the initial webpage to the target webpage; obtaining a frequent item set of the URL regular pattern of at least one access task, wherein the frequent item setcomprises the URL regular pattern of each access task corresponding to a plurality of webpage navigation sequences from the initial webpage to the target webpage; and determining a navigation path ofthe target webpage according to the frequent item set. According to the webpage path navigation method disclosed by the invention, the path navigation of a crawler can be automatically and intelligently analyzed according to the association rule mining algorithm, so that the traversal times of the webpage path can be reduced, and the knowledge extraction efficiency in the webpage can be improved.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a web page path navigation method, device, electronic equipment and storage medium. Background technique [0002] At present, HTML, the standard language of Web pages, cannot meet the needs of knowledge representation. Usually, standard language specifications, RDF, RDFS and OWL are embedded in HTML to represent the knowledge of web pages. In order to facilitate knowledge sharing, it is necessary to extract knowledge from web pages (such as the Semantic Web) and form a knowledge graph. Knowledge can be obtained from the Internet through crawler technology, but the application of crawler technology usually requires a clear web page address. However, the web page address is sometimes updated irregularly, causing the crawler technology to fail. And although there are some depth-first crawlers based on a certain topic, which determine the web page address by traversal, the exh...

AI Technical Summary

Problems solved by technology

Knowledge can be obtained from the Internet through crawler technology, but the application of crawler technology usually requires clear web page addresses

However, the address of the web page is sometimes updated irregularly, which leads to the invalidation of crawler technology.

And although there are some depth-first crawlers based on a certain topic, which determine the web page address by traversal, the exhaustive link method is adopted, which wastes a lot of time-consuming execution of URLs that have nothing to do with the topic.

Images