Web Resource Creation Time Determination via Link Probability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods lack an efficient and accurate way to determine the creation time of web resources, which is crucial for tasks like web crawler scheduling and search result ranking.
Innovation Solution
A method and system that create a page network with linked pages, where the creation time of a target page is determined by maximizing the page network probability based on link probabilities, which consider the age difference and quality parameters of source and destination pages.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional methods are used to determine creation time of web resources, then the process is simple, but the accuracy and reliability of creation time determination is insufficient
Solution Approach 1:
The patent introduces link probability as an intermediary mechanism to infer creation time. Instead of directly measuring creation time, the system uses the probability of links between pages as a mediator to indirectly determine creation time based on the temporal relationships embedded in the link structure.
Solution Approach 2:
The system employs feedback mechanisms where the determined creation times are used to validate and refine link probability calculations. The creation time information feeds back into the link probability model to improve future determinations, creating a self-enhancing system that increases accuracy over time.
2Productivity
If creation time determination is not accurately implemented, then web crawler scheduling and search result ranking are inefficient, but implementing accurate determination increases computational complexity
Solution Approach 1:
The patent performs preliminary actions by pre-calculating and storing link probability values between pages. This preliminary computation allows the web crawler to efficiently retrieve and use creation time information during scheduling without performing complex calculations in real-time, thus improving productivity while managing computational complexity.
Solution Approach 2:
The system dynamically adjusts the computational effort based on the specific requirements of crawler scheduling and search ranking tasks. For frequently accessed pages, the system maintains pre-computed creation times, while for less critical operations, simplified estimation methods are used, optimizing the balance between productivity and computational complexity.
Data Source
AI summary
A method and server for determining a creation time of a target page is disclosed. A page network of a plurality of pages including the target page and a plurality of links therebetween is created. Each page is a source or destination page for at least one link. Each page has a creation time and a creation time parameter. An initial value is assigned to the creation time parameter for each page. The creation time parameter of the target page is varied to maximize a page network probability which is based on a link probability for each link which is based at least in part on a difference between the creation time parameters of the source and destination pages thereof. The creation time of the target page is determined to be the value of the creation time parameter thereof which maximizes the page network probability.