Web Page Creation Time Estimation via Link Probability Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for determining the creation time of web resources are often inaccurate or inefficient, particularly when information about the creation time is not directly available, which hinders tasks like web crawler scheduling and search result ranking.
Innovation Solution
A method and system that create a page network of linked pages to estimate the creation time of a target page by calculating the page network probability based on link probabilities between source and destination pages, using a hypothetical creation time that maximizes the overall probability of the page network.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional methods are used to determine creation time of web resources, then the process is simple, but the accuracy is poor when direct information is unavailable
Solution Approach 1:
The patent uses link probability as an intermediary to indirectly determine creation time. Instead of directly extracting creation time from web pages, the system calculates the probability of links between pages and uses this intermediate metric to infer creation time, thereby improving accuracy when direct information is unavailable.
Solution Approach 2:
The patent replaces traditional mechanical information extraction methods with a probabilistic mathematical model. By substituting direct parsing with probability calculations based on link analysis, the system achieves better accuracy at the cost of increased computational complexity.
2Productivity
If web crawler scheduling and search result ranking are improved through accurate creation time determination, then information retrieval efficiency increases, but computational resources required increase
Solution Approach 1:
The patent applies partial action by calculating link probabilities only for relevant pages in the page network rather than all pages. This selective approach improves information retrieval efficiency while reducing unnecessary computational resource consumption on irrelevant pages.
Solution Approach 2:
The system dynamically adjusts the probability threshold parameter to balance between retrieval efficiency and computational cost. By changing this parameter, the system can optimize performance based on available computational resources while maintaining improved accuracy over traditional methods.
Data Source
AI summary
A method for determining a creation time of a target page includes creating a page network having a plurality of pages including the target page and a plurality of links. Each of the source and destination pages for each link is one of the plurality of pages. Each page is a source page or a destination page for at least one of the links. A page network probability corresponding to a hypothetical creation time for the target page is determined. The page network probability is based on a link probability for each link of the plurality of links, the link probability being based on a creation time for the source page thereof and a creation time for the destination page thereof. A value of the hypothetical creation time providing the greatest value for the page network probability is determined, the value being the creation time for the target page.