Partial Index Segmentation for Distributed Database Query Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional database indexes in non-relational and dynamic schema environments struggle to efficiently include records based on criteria fields not included in the index, leading to performance issues and increased processing time due to the need for extraneous fields, which dilutes the index's usefulness.
Innovation Solution
A system and method for creating partial database indexes using criteria fields distinct from index fields, allowing for filtered indexes that reduce processing time and error, improve query efficiency, and enable more indexes to be maintained in memory, by using a criteria field and condition to selectively include records in the index.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional database indexes include all fields necessary for query filtering, then query accuracy is improved, but index size and processing time increase
Solution Approach 1:
The patent segments the index into two distinct parts: index fields (for efficient data location) and criteria fields (for filtering). This segmentation allows the index to store only the minimum necessary fields for locating data, while filtering is performed separately using criteria fields, thereby reducing index size and processing time while maintaining query accuracy.
Solution Approach 2:
The patent extracts the filtering function from the traditional index structure. Instead of including all filtering fields within the index, the criteria fields are separated and used to filter results after the index locates candidate records. This extraction reduces the index's computational burden and size while preserving query accuracy.
2Adaptability or versatility
If conventional database indexes include extraneous fields for filtering, then query flexibility is improved, but index performance deteriorates
Solution Approach 1:
By segmenting the index and criteria fields, the patent enables flexible querying without including extraneous fields in the index structure. The criteria fields can be freely added or modified to support different query types, while the index fields remain optimized for performance.
Solution Approach 2:
The patent applies local quality by giving different functions to different parts of the query system: index fields are optimized for fast data location with simple data structures, while criteria fields handle the complexity of filtering and adaptability. This separation allows each component to be optimized for its specific purpose.
3Loss of information
If conventional database indexes store complete field data, then data completeness is improved, but memory usage and storage requirements increase
Solution Approach 1:
The patent extracts only the essential fields needed for indexing and storing them in a compact index structure. Complete field data is not stored in the index; instead, the index stores minimal information necessary for locating records, while the actual complete data remains in the original database records.
Solution Approach 2:
The patent creates a simplified copy of the data structure for indexing purposes. The index contains a streamlined version with only index fields, while the full data with all fields remains in the original records. This copying approach maintains data completeness in the source while reducing memory usage in the index.
Data Source
AI summary
According to one aspect, methods and systems are provided for creating partial indexes in a distributed database environment. The database includes an index engine configured to receive at least one index field, a criteria field, and a criteria condition, wherein the criteria field is not included in the at least one index field; and generate an index comprising the at least one index field from at least one record of the plurality of records and a pointer to the at least one record of the plurality of records, wherein the criteria field of the at least one record of the plurality of records satisfies the criteria condition. The database further includes a query engine configured to receive a search query containing the at least one index field; and search the index for the at least one index field.