Information Retrieval Using Embedded Link Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional information retrieval methods from electronic documents fail to effectively utilize embedded links, leading to limited search results and missed relevant information, as they do not consider the attributes of links during the search process.
Innovation Solution
A method and system that preprocess information sources to extract content from text and existing links, including hypermedia and hypertext links, and generate search results based on user queries, with the ability to rank and cluster information sources to enhance search quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional searching methods are used that process embedded links as normal content, then the search process is simple, but the search results are limited and relevant information is missed
Solution Approach 1:
The patent applies preliminary action by preprocessing information sources before search queries are executed. During this preprocessing phase, embedded links are identified, extracted, and stored in a separate structure that preserves their relationships to source documents. This advance preparation enables the search system to quickly access and utilize link content without adding complexity to the real-time search process.
Solution Approach 2:
The patent segments the information source into two distinct components: the main content text and the embedded links. By separating links from the primary content during preprocessing and storing them in a dedicated data structure, the system can independently process and search link content without interfering with the main text search, thereby recovering lost relevant information while maintaining search efficiency.
2Measurement precision
If embedded links are extracted and processed separately, then search results become more comprehensive, but the processing complexity increases
Solution Approach 1:
The system performs link extraction and organization during a preprocessing phase before actual search queries are executed. By preparing the link data structure in advance and storing it separately, the system achieves high search result quality without adding complexity to the real-time search operation. The preprocessing complexity is paid once during data preparation, not repeatedly during each search.
Solution Approach 2:
The patent introduces an intermediary data structure that stores extracted links and their relationships to source documents. This intermediary layer acts as a buffer between the raw information sources and the search query processing system, enabling comprehensive link analysis without directly complicating the search engine's core operations. The intermediary structure organizes link data in a searchable format that improves measurement precision while isolating processing complexity.
3Loss of information
If link attributes are considered during search, then relevant information is recovered, but the search process becomes more complex
Solution Approach 1:
The patent segments link attributes (such as source document, target URL, link text, and contextual information) into structured fields within the intermediary data structure. This segmentation allows the search system to query specific link attributes without processing the entire information source, thereby recovering matching content while maintaining ease of operation through targeted, efficient queries on pre-organized data.
Solution Approach 2:
By pre-extracting and organizing link attributes during the preprocessing phase, the system prepares all necessary link information in advance. During the actual search operation, the system simply queries this pre-organized attribute data without needing to parse or analyze the original information sources, thus recovering matching content while keeping the search process simple and easy to operate.
Data Source
AI summary
Retrieving information from information sources using links. A set of information sources is preprocessed to extract content from text and existing links in the information sources according to some predetermined criteria. A set of search results is generated from amongst the preprocessed information sources in response to a received search query.