SEM Campaign Measurement System Using Segmented Crawlers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to effectively measure the effectiveness of search engine marketing (SEM) campaigns, including search engine optimization (SEO) and search engine advertising (SEA), particularly in comparing a business entity's efforts to those of its affiliates and competitors across various search engines and time periods.
Innovation Solution
A system and method that classifies websites into personal, affiliate, and competitor categories, acquires relevant data, and analyzes it to model and optimize the effectiveness of SEM campaigns, providing recommendations for improving SEO and SEA initiatives and campaigns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated technology is used to track SEM activities, then data collection capability is improved, but the ability to measure competitor and affiliate effectiveness simultaneously deteriorates due to technical limitations
Solution Approach 1:
The system segments the measurement task by creating separate crawlers for different target types (competitors, affiliates, own websites) and different search engines. Each crawler is configured with specific parameters for its target category, allowing simultaneous tracking of multiple entities without technical conflict. This segmentation enables the system to overcome the limitation of measuring only one type of target at a time.
2Loss of information
If comprehensive data is collected from multiple search engines and time periods, then measurement completeness is improved, but system complexity deteriorates
Solution Approach 1:
The system implements a universal crawler architecture that can operate across multiple search engines (Google, Yahoo, MSN, etc.) and track multiple target types (competitors, affiliates, own sites) using the same core infrastructure. The crawler is configured with adjustable parameters rather than requiring separate systems for each search engine, reducing overall system complexity while maintaining comprehensive measurement capability.
3Measurement precision
If detailed classification of websites is implemented, then analysis precision is improved, but data processing complexity deteriorates
Solution Approach 1:
The system applies different classification criteria and analysis methods tailored to each target category (competitors, affiliates, own websites). For example, competitor analysis focuses on market share and ranking positions, while affiliate analysis emphasizes conversion tracking and ROI. This localized approach to data processing reduces unnecessary computational overhead while maintaining high precision for each specific analysis type.
Data Source
AI summary
A system and method for modeling and optimizing the effectiveness of search engine optimization (“SEO”) initiatives and search engine marketing (“SEA”) campaigns is described. Several embodiments include methods and systems for classifying each of a plurality of websites using at least one of a plurality of classifications. Data associated with the plurality of websites is then acquired. The acquired data is then analyzed to achieve a result which may be used to model or optimize the effectiveness of the SEO initiatives and SEA campaigns.