Search Result Deduplication via Device-Specific Content Clustering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Search systems face inefficiencies in serving diverse results and eliminating duplicate search results across different devices, leading to reduced search quality and increased costs due to the need for separate indexes and crawling processes.
Innovation Solution
A method that identifies duplicate search results by determining which resources redirect to the same content on user interaction, replacing these with a single reference or clustering them, thereby improving search quality and efficiency without creating separate indexes for devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate search indexes are created for different devices, then search quality for each device is improved, but system complexity and costs increase
Solution Approach 1:
The patent segments the deduplication process by device characteristics. Instead of creating separate indexes, it segments the search result processing by identifying device-specific duplicate patterns and applying targeted deduplication logic for each device type, thereby maintaining search quality without multiplying the entire indexing system
Solution Approach 2:
The patent introduces an intermediary deduplication layer between the unified search index and the user. This intermediary process analyzes search results based on device characteristics and removes duplicates without requiring separate indexes, thus improving search quality while avoiding the complexity of multiple indexing systems
2Measurement precision
If separate search indexes are created for different devices, then search quality for each device is improved, but crawling and indexing costs increase
Solution Approach 1:
The patent merges the deduplication function into the existing search indexing pipeline rather than creating separate indexing processes for each device. By combining device-specific deduplication logic with the unified index, it achieves device-optimized search results without duplicating the expensive crawling and indexing operations
Solution Approach 2:
The patent performs preliminary deduplication analysis during the search result generation phase by examining device characteristics and identifying duplicates before presenting results to users. This preliminary action avoids the need for costly post-hoc separate indexing operations for different device types
3Quantity of substance
If duplicate search results are not eliminated, then more search results are provided, but search efficiency and user experience deteriorate
Solution Approach 1:
The patent extracts and removes duplicate search results from the result set based on device-specific analysis. By taking out only the redundant entries while preserving unique valuable results, it maintains an adequate quantity of search results while dramatically improving search efficiency and user experience
Solution Approach 2:
The patent changes the parameter of result uniqueness by applying device-specific deduplication criteria. It adjusts which results are considered duplicates based on device characteristics, thereby optimizing the balance between providing sufficient results and eliminating waste, improving overall search efficiency
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying a plurality of search results that will be provided in response to a search query received from a user device. Two or more of the search results may reference at least two different resources that are responsive to the search query. It may be determined that the user device will be served a same set of content in response to user interaction with each of the two or more search results. In response to the determination, a replacement search result may be generated, including a reference to a resource serving the same set of content. In response to receiving the search query, a search page may be presented that includes the replacement search result and does not include at least one of the two or more identified search results.