Feed Fetching Latency Optimization via Dual-Query Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face frustration due to long wait times for content on webpages, leading to a trade-off between response time and quality of service in online services like social networks, where quick delivery of interesting content is essential but often compromised by the need to sift through large amounts of data.
Innovation Solution
Implementing a system that splits feed fetching into two processes, using a fast query for recent updates and a slower query for additional updates, with AI predictive models to determine content relevance and preloading cache based on user behavior, allowing for quick delivery of quality content by blending results from both queries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the online service sorts through a large amount of data to get the information that most interests the user, then the quality of content is improved, but the response time increases
Solution Approach 1:
The patent divides the feed fetching process into two separate queries: a fast query that retrieves recent updates quickly, and a slower query that retrieves additional updates with broader time horizons. This segmentation allows the system to deliver high-quality content by combining results from both queries while minimizing the perceived response time by presenting fast results first.
Solution Approach 2:
The system performs preliminary actions by preloading cache based on user behavior predictions using AI models. This allows the system to have content ready in advance, reducing the actual response time when users request their feeds while maintaining content quality through pre-filtered and pre-ranked results.
2Manufacturing precision
If the user waits a long time to get the best content, then the quality of service is improved, but the user satisfaction decreases
Solution Approach 1:
The patent segments the content delivery into immediate results from the fast query and subsequent results from the slower query. This allows users to immediately see relevant content without waiting for comprehensive processing, improving satisfaction while maintaining quality through the blended results of both queries.
Solution Approach 2:
The system performs partial action by initially delivering a subset of the best content through the fast query rather than waiting for complete processing. This partial delivery satisfies user needs immediately, with the understanding that additional content will follow, thereby maintaining both quality and user satisfaction.
3Speed
If the online service delivers content quickly, then the response time is improved, but the quality of content may decrease
Solution Approach 1:
The patent uses segmentation to separate the quick delivery function (fast query for recent updates) from the comprehensive quality assurance function (slower query for additional updates with broader criteria). By blending results from both queries, the system achieves both speed and quality simultaneously.
Solution Approach 2:
The system merges results from two different queries with different time horizons and ranking criteria. This combination allows the fast query to provide immediate response while the slower query ensures content quality, and their merged results deliver both speed and quality in the final feed presentation.
Data Source
AI summary
Methods, systems, and computer programs are presented for reducing latency for providing a user feed containing one or more posts. One method includes operations for receiving a request to access the user feed and for performing a first query to search posts. The first query uses a first time horizon delimiting a creation time of posts and a first maximum number of posts selected for ranking. The posts from the first query are sent to the client device for presentation on a user interface. Further, a second query is performed to search posts, where the second query uses a second time horizon that is greater than the first time horizon and a second maximum number of posts for ranking that is greater than the first maximum number of posts. The posts from the first query and the second query are merged and sent to the client device for presentation.