Orphan Content Detection via Reverse Link Tracing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for detecting orphan content within websites are inefficient, as they do not ensure all web pages and links are parsed, leading to inaccessible data and resource inefficiency.

Innovation Solution

A method and system that analyze links within selected directories in a hierarchical data tree structure, using a hashtable to identify orphan files by processing each object and determining if file identifiers and link identifiers exist, generating a report for orphan content detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If spider technology is used to crawl web pages by following links, then the software can navigate through interconnected web pages, but it does not ensure that all web pages and links are parsed

Engineering Contradiction:
Improveability to navigate web pagesVSAvoidcompleteness of link analysis
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

Instead of starting from web pages and following links forward (source-to-target), the invention inverts the approach by starting from links and tracing them backward to their source files. This reverse crawling ensures that all links are discovered and analyzed, not just those reachable from the starting page, thereby improving the completeness and reliability of orphan content detection.

Inventive Principle:
Principle #13The other way round (Inversion)

2Productivity

If conventional link checking software is used, then some links can be detected, but orphan content cannot be reliably identified due to incomplete parsing

Engineering Contradiction:
Improvespeed of link checkingVSAvoidaccuracy of orphan content detection
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The invention introduces an intermediary data structure (a hash table or dictionary) that stores the mapping between links and their source files. This intermediary allows the system to efficiently track which files contain which links, enabling accurate identification of orphan files (files with no incoming links) while maintaining fast processing speeds through O(1) lookup operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If a hierarchical directory structure is used to organize content, then content can be systematically arranged, but orphan content becomes difficult to locate and manage

Engineering Contradiction:
Improveorganization of contentVSAvoidlocating orphan content
Core Design Contradiction:
Ease of manufactureVSDifficulty of detecting and measuring

Solution Approach 1:

The invention implements a feedback mechanism by generating a comprehensive report that lists all detected orphan files with their locations in the hierarchical directory structure. This feedback provides users with actionable information about where orphan content exists, enabling easy navigation and management. The system continuously monitors and updates the orphan file status as the website evolves, providing ongoing feedback for content maintenance.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8671108B2Methods and systems for detecting website orphan content
Publication Date: 2014.03.11 MASTERCARD INT INC
  • US8671108B2 patent drawing
  • US8671108B2 patent drawing
  • US8671108B2 patent drawing

AI summary

A method and system for detecting orphan content in a hierarchical data tree are provided. The method includes receiving, at the computer, a selection of at least one directory that includes a plurality of data files to be analyzed, analyzing all links embedded within the data files stored in the at least one selected directory, detecting files that are not referenced by a link in any other data file, determining that no other links are embedded within the data files stored in the at least one selected directory, and generating an orphan content report that includes link data for each orphan file detected.