Search Index Biword Priority for Document Sections
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional document searching technologies are ineffective for non-text based documents like PDFs, which often contain multiple sections and pages, requiring users to manually search within the document to find relevant information, and lack efficient indexing and retrieval methods.
Innovation Solution
A method for analyzing and indexing documents by converting them into text streams, identifying sections, and assigning priority values to words and bi-words, with a search index structure that prioritizes bi-words for improved content scoring and retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional indexing techniques are used for non-text documents, then document structure is preserved, but search effectiveness deteriorates
Solution Approach 1:
The patent segments non-text documents into multiple text streams based on their structural components (e.g., different layers, formats, or content types). Each text stream is indexed separately with appropriate weighting, allowing the search system to process and evaluate different document segments independently while maintaining overall document structure integrity.
Solution Approach 2:
The patent applies different indexing strategies and priority weights to different sections or streams within the same document. By assigning local quality parameters (priority values) to specific text streams based on their relevance to user queries, the system optimizes search effectiveness for each document component while maintaining overall document structure.
2Measurement precision
If users manually search within documents, then precise location is found, but time consumption increases
Solution Approach 1:
The patent performs preliminary indexing of document sections and streams before actual search operations. By pre-processing documents into structured text streams with assigned priorities and metadata during the indexing phase, the system eliminates the need for manual searching while maintaining precise location identification through the pre-established index structure.
3Measurement precision
If all words are indexed with equal priority, then simplicity is maintained, but search accuracy deteriorates
Solution Approach 1:
The patent assigns different priority values to words based on their location within specific text streams and sections of the document. Words in more relevant streams or sections receive higher priority weights, improving search accuracy by emphasizing important content while maintaining a manageable indexing structure through systematic priority assignment.
Data Source
AI summary
A method for processing a search query according to one embodiment includes receiving a search query containing terms; combining at least some consecutive terms in the search query to create biwords; looking up at least some of the terms and biwords in a search index for identifying sections of documents containing the at least some of the terms and/or biwords; generating a content score for each of the identified sections based at least in part on a number of the terms and biwords found in the sections of each document, wherein the biwords are given a higher priority than matched terms, wherein the priority affects the content score; and selecting and outputting an indicator of at least one of the sections, or portion thereof, based at least in part on the content score.