Content Index Update via Packet Inspection and Database Triggers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for updating content indexes on networks are inefficient, leading to either excessive processor usage with short crawling intervals or stale search results with longer intervals, as they rely on periodic crawling of databases to detect changes.
Innovation Solution
Detecting changes in content externally by examining packets en route to a data repository and using database triggers to propagate updates to the content index, reducing overhead on applications and crawlers, and allowing asynchronous updates without frequent crawling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the crawling interval is shortened to update indexes more frequently, then the accuracy of search results is improved, but the processor time and power consumption increase
Solution Approach 1:
The system performs preliminary detection of content changes by monitoring packets before they reach the data repository. Database triggers are activated in advance to detect changes as they occur, rather than waiting for periodic crawling. This preliminary detection mechanism allows the index to be updated only when necessary, avoiding the continuous processor load of frequent crawling while maintaining search result accuracy.
Solution Approach 2:
The patent introduces an intermediary packet detection mechanism that sits between the content source and the crawler. Instead of the crawler directly and frequently accessing the database, packet intermediaries monitor data flows and notify the system of changes. This intermediary layer filters out unnecessary crawling operations, reducing processor time and power consumption while still capturing all relevant content changes for accurate search results.
2Use of energy by moving object
If the crawling interval is lengthened to reduce processor usage, then the energy consumption is reduced, but the search results become stale and inaccurate
Solution Approach 1:
The system implements a feedback mechanism through database triggers that automatically detect content changes and notify the indexing system. When a change is detected, the trigger generates a notification that initiates an index update. This feedback loop ensures that the index remains synchronized with the actual content without requiring frequent polling, thereby reducing energy consumption while preventing search result staleness.
Solution Approach 2:
The database triggers perform self-service by automatically detecting and reporting content changes without external intervention. The system does not need to actively query or crawl the database at intervals; instead, the database itself services the change detection function through triggers. This self-service approach eliminates the energy cost of periodic crawling while maintaining real-time awareness of content changes for accurate search results.
3Ease of manufacture
If periodic crawling is used to update indexes, then the implementation is simple, but the processor overhead and power consumption increase
Solution Approach 1:
The patent replaces the mechanical periodic crawling system with an event-driven trigger-based system. Instead of a crawler mechanically accessing the database at scheduled intervals, database triggers automatically activate when content changes occur. This substitution eliminates the continuous mechanical operation of periodic crawling and its associated processor overhead, while the trigger mechanism remains conceptually simple to implement within the database system.
4Measurement precision
If frequent crawling is performed to ensure accurate search results, then the search accuracy is improved, but the complexity of the system increases
Solution Approach 1:
The patent extracts the change detection function from the crawling mechanism and places it within the database system through triggers. By taking out the detection responsibility from the external crawler and embedding it in the database itself, the system achieves accurate change detection without the complexity of a sophisticated crawling and monitoring infrastructure. The trigger-based approach leverages existing database capabilities, avoiding the need for complex external detection systems.
Data Source
AI summary
According to an aspect of the present invention, update requests indicating the changes in content are created external to an application causing the changes, and a content index is updated based on the update requests. In an embodiment, the changes are detected based on examining packet contents on the way to a data repository (e.g., database server). As a result, the overhead in data repositories as well as any crawlers updating the content index may be reduced.