Code Page Tracking for Search Indexing Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current indexing methods for search engines often lose information when using a default code page for indexing documents, leading to reduced search accuracy due to the lack of consideration for the actual code pages used in the documents.
Innovation Solution
The method involves tracking and storing both indexing information and code page information for documents, allowing for the determination of a relevance degree between documents and search queries by considering the code pages associated with the documents.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a default code page is used for indexing documents, then the indexing process is simplified and faster, but search accuracy deteriorates due to loss of code page information
Solution Approach 1:
The patent segments the indexing process into two independent parts: extracting indexing information (text content) and detecting code page information. These segments are then stored separately but associated together, allowing the indexing to remain efficient while preserving code page data for improved search accuracy later.
Solution Approach 2:
The patent performs preliminary detection of code page information during the indexing phase and stores it alongside the indexing information. This preliminary action ensures that code page data is captured before search operations occur, enabling accurate relevance determination without slowing down the indexing process.
2Measurement precision
If code page information is tracked and stored for each document, then search accuracy is improved, but device complexity increases
Solution Approach 1:
The patent merges the storage of indexing information and code page information into a unified structure where both types of data are associated together for each document. This merging approach simplifies the system by using a single data structure rather than separate complex systems, while still enabling accurate search relevance determination.
3Measurement precision
If code page information is considered in search queries, then relevance determination is improved, but processing time increases
Solution Approach 1:
The patent performs the detection and extraction of code page information as a preliminary action during the indexing phase. By pre-processing and storing code page data alongside indexing information, the system avoids the need for complex real-time code page analysis during search queries, thus improving relevance determination without significantly increasing processing time.
Data Source
AI summary
A processor may determine indexing information for indexing a document. The indexing information may comprise at least one index extracted from the document. The processor may identify at least one code page associated with the document. The processor may store the indexing information in association with code page information indicating the at least one code page. In response to a search query, the processor may determine a relevance degree between the document and the search query based on the indexing information and the code page information.