Adaptive Sub-Index Formats for Memory-Limited Record Search
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud storage services face high memory consumption due to the need for indexing data, which requires significant memory resources for efficient data localization and search functionality.
Innovation Solution
An index creation method that divides storage records into logical sub-storage areas and determines an index format matching record attributes, creating sub-indices that occupy less memory space than a preset capacity, using various index formats optimized for different record characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the mapping of the index resides in memory to improve search performance, then search efficiency is improved, but memory consumption increases
Solution Approach 1:
The patent divides the storage area into multiple logical sub-storage areas and creates separate sub-indices for each sub-area. Each sub-index is stored in memory independently, allowing the system to manage memory resources more efficiently by loading only the necessary sub-indices based on access patterns, thus reducing overall memory consumption while maintaining search efficiency for specific data ranges.
Solution Approach 2:
The patent applies different index formats (first index format and second index format) to different sub-indices based on their specific characteristics and access requirements. This allows optimization of memory usage for each sub-index individually, using more compact formats where possible while maintaining search performance where needed, thereby resolving the contradiction between search efficiency and memory consumption.
2Measurement precision
If a comprehensive index is created to maintain all storage data mappings, then data localization accuracy is improved, but device complexity increases
Solution Approach 1:
The patent segments the comprehensive index into multiple sub-indices, each corresponding to a logical sub-storage area. This segmentation reduces the complexity of managing a single large index while maintaining accurate data localization within each sub-area. The system can manage and optimize each sub-index independently, reducing overall device complexity.
Solution Approach 2:
The patent dynamically selects between different index formats for different sub-indices based on their characteristics and access patterns. This dynamic approach allows the system to adapt the index structure to actual usage requirements, maintaining high data localization accuracy while avoiding the complexity of a static, overly comprehensive index structure.
Data Source
AI summary
An index creation method, a computing device, and a storage medium are provided. The method comprises: dividing storage records in logic sub-storage areas on the basis of the storage records and the logic sub-storage areas in a logic storage area divided in a physical storage area, the storage records comprising storage data; determining, from among multiple preset index formats according to the divided storage records, an index format matched with a record attribute; and creating a corresponding sub-index according to the determined index format to search for storage records according to the sub-index, the index format being able to cause the generated corresponding sub-index to occupy memory space smaller than a preset capacity. The index format matched with the record attribute is determined from among the multiple preset index formats, the index format can cause the generated corresponding sub-index to occupy memory space smaller than the preset capacity.