Web Archive Duplicate Content Removal via Extraction

The patent extracts and removes third-party dynamically added content from the archived web page data. During the archiving process, the system identifies content originating from third-party sources (such as advertisements, tracking scripts, or embedded content from external domains) and excludes it from the archived files. This prevents duplicate content errors when the page is restored, as the third-party content that would normally be reloaded dynamically is already excluded from the static archive, thereby maintaining display accuracy while preserving essential first-party content.

The system extracts and removes harmful third-party content during archiving, specifically targeting dynamically added elements such as advertisements, tracking scripts, and embedded content from external domains. By excluding these problematic elements from the archive while preserving essential first-party content, the system prevents user confusion and browser errors that would otherwise occur when duplicate content is displayed during page restoration.

The patent applies local quality by differentiating between first-party content and third-party content within the web page. The system selectively preserves essential first-party content (such as main page structure, core functionality, and primary resources) while removing harmful third-party content (such as advertisements, tracking scripts, and external embedded content). This selective approach maintains display accuracy by preventing duplicate content errors while minimizing content loss through intelligent identification and preservation of important local elements.