Tag Inspection System Automates Web Crawler Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for inspecting and managing tags in web pages are inefficient, particularly in identifying and analyzing marketing and analytic tags, as they require manual effort and struggle with detecting piggybacking tags, leading to difficulties in comprehensive tag management and monitoring.

Innovation Solution

A tag inspection system comprising a user interface module, a tag inspector module, and a web crawler module that automates the identification, analysis, and reporting of tags on web pages, including real-time monitoring and visualization of tag performance, using configuration rules and data storage to generate reports on tag usage and health.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual methods are used for inspecting and managing tags in web pages, then simplicity of implementation is maintained, but productivity and measurement precision deteriorate due to inefficiency and inability to detect piggybacking tags

Engineering Contradiction:
Improvetag inspection efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The tag inspection system is divided into distinct functional modules: a web crawler module for accessing web pages, a tag inspector module for analyzing tags, and a user interface module for configuration and reporting. This segmentation allows each module to specialize in specific tasks, improving overall inspection efficiency while keeping individual module complexities manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The tag inspector module acts as an intermediary between the web crawler and the analysis system. It receives web pages from the crawler, processes tags through systematic inspection, and passes structured data to the reporting system. This intermediary layer enables automated detection of piggybacking tags and improves measurement precision without requiring direct complex interactions between all system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If comprehensive tag analysis is performed to detect all tags including piggybacking tags, then measurement precision and reliability improve, but loss of time and computational resources increase

Engineering Contradiction:
Improvetag detection accuracyVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The web crawler module pre-loads and stores web pages before tag inspection begins. This preliminary action ensures that all necessary web content is readily available when the tag inspector needs to analyze tags, eliminating delays during the actual inspection process and enabling comprehensive tag detection without time loss.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The tag inspector module continuously processes tags as they are encountered during web page crawling, rather than pausing to analyze each tag individually. This continuous inspection approach maintains measurement precision for detecting piggybacking tags while minimizing inspection time by keeping the analysis workflow uninterrupted and efficient.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11533357B2Systems and methods for tag inspection
Publication Date: 2022.12.20 INFOTRUST LLC
  • US11533357B2 patent drawing
  • US11533357B2 patent drawing
  • US11533357B2 patent drawing

AI summary

Technologies for identifying and inspecting web page tags include a tag inspection system. The tag inspection system receives configuration information, which includes a seed uniform resource locator. The tag inspection system accesses a web page corresponding to the seed uniform resource locator. A tag of the web page is invoked by the tag inspection system. Tag execution data is received in response to invocation of the tag of the web page. The received tag execution data is analyzed by the tag inspection system. A report is generated based on the analysis of the received tag execution data. Other embodiments are described and claimed.