Pseudo-Document Index for Accurate Document Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional information retrieval methods are limited in accuracy and relevance, often returning irrelevant documents and failing to include useful documents that do not match specific search queries, and lack a simple method to retrieve documents similar to a user-identified relevant document.
Innovation Solution
A system and method that generates pseudo-documents based on a set of documents, creating an index to identify documents with predefined relationships, allowing for more accurate and relevant search results by using a query-based index, which includes generating pseudo-documents and indexing them to facilitate efficient retrieval of similar documents.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional search query methods are used to retrieve documents, then the search process is simple and fast, but the accuracy and relevance of search results deteriorate because irrelevant documents are returned and useful documents are missed
Solution Approach 1:
The patent segments the document collection into multiple pseudo-documents, each representing a subset of documents that would be retrieved by a specific basis query. This segmentation allows the system to organize documents according to their retrieval contexts rather than their content alone, improving search accuracy by capturing documents that are relevant in specific query contexts even if they don't contain the exact search terms.
Solution Approach 2:
The patent introduces pseudo-documents as an intermediary layer between the original document collection and the search query processing. These pseudo-documents act as mediators that bridge the gap between conventional text-based search and more accurate retrieval, allowing the system to return documents based on their presence in query-result contexts rather than relying solely on term matching.
2Adaptability or versatility
If conventional text-based search is used, then the search method is straightforward, but it fails to retrieve documents that are similar to a user-identified relevant document
Solution Approach 1:
The patent performs preliminary action by pre-computing pseudo-documents based on a set of basis queries before actual search operations. This preprocessing step creates an index structure that captures document relationships in advance, enabling the system to quickly retrieve similar documents during search without performing complex computations at query time.
Solution Approach 2:
The patent creates an asymmetric index structure where pseudo-documents are generated differently from traditional inverted indexes. Instead of organizing by terms to documents, the system organizes by query-results to pseudo-documents, creating an asymmetric relationship that enables similarity-based retrieval while maintaining efficient search performance.
3Reliability
If conventional search approaches are used, then the system operates with simple document-term matching, but it returns documents that are irrelevant to the query and misses useful documents
Solution Approach 1:
The patent adds another dimension to the traditional document-term matching by introducing the query-context dimension. Instead of only considering whether documents contain query terms, the system considers which queries originally retrieved which documents, creating a new dimension of relevance based on query-result relationships that improves document reliability.
Solution Approach 2:
The patent makes the search system multi-functional by enabling it to perform both conventional term-based search and similarity-based retrieval through the pseudo-document index. The same index structure supports multiple retrieval modes, allowing the system to adapt to different search needs without requiring separate specialized systems.
Data Source
AI summary
A search system generates a plurality of pseudo-documents for a set of documents. Each pseudo-document includes a representation one or more documents from the set of documents that would be retrieved in response to executing a respective basis query over the set of documents. The search system generates an index of the plurality of pseudo-documents. The index provides an indication, for a plurality of respective documents from the set of documents, of the pseudo-documents that include a representation of the respective document. After generating the index, the search system receives a document-query that includes a representation of a first document; and in response to receiving the document-query, the search system identifies one or more pseudo-documents that include representations of at least one document having a predefined relationship to the first document; and generates a result that is based on the first set of one or more pseudo-documents.