Graph Property Indexing During Data Import and Inventory Sync
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing graph databases face challenges in creating timely and reliable property indexes, leading to inefficient querying and data management, particularly when manual intervention is required for index creation and backup processes are inadequate.
Innovation Solution
An automated method and apparatus for creating property indexes in graph databases by identifying inventory data lacking indexes during data import, jointly processing inventory and new data, and implementing block processing to ensure timely index creation, expiry-based eviction, and multi-version incremental backup.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual intervention is required for index creation, then device complexity is reduced, but productivity deteriorates due to inefficient querying and delayed index creation
Solution Approach 1:
The graph database system automatically detects when inventory data lacks property indexes and creates the necessary indexes without manual intervention. The system monitors its own state, identifies missing indexes based on property index definitions, and executes index creation autonomously, thereby improving productivity while keeping the automation mechanism integrated within the existing system architecture.
Solution Approach 2:
The system performs preliminary actions by checking whether inventory data has property indexes before data import operations. This preventive check ensures that indexes are created in advance or during the import process itself, avoiding delays in query execution and ensuring timely index availability without requiring post-hoc manual index creation.
2Measurement precision
If property indexes are created for all data, then measurement precision of query results is improved, but loss of substance increases due to storage costs
Solution Approach 1:
The system applies property indexes selectively based on local quality principles. Instead of uniformly creating indexes for all data, it identifies specific inventory data that lacks indexes and creates property indexes only for those specific datasets where queries are needed. This targeted approach ensures query result accuracy for affected data while minimizing unnecessary storage consumption across the entire database.
Solution Approach 2:
The system changes the parameter of index creation from a blanket approach to a conditional approach based on data state. It monitors the presence or absence of property indexes as a parameter and only creates indexes when inventory data is identified as lacking them. This dynamic parameter adjustment optimizes the balance between query result precision and storage resource consumption.
3Loss of time
If inventory data is processed separately, then device complexity is reduced, but loss of time increases due to delayed index creation
Solution Approach 1:
The system merges the index creation process with the data import operation. Instead of processing inventory data separately and then creating indexes in a subsequent step, the system combines both operations into a single integrated workflow. The index creation is performed during the data import process itself, eliminating delays and reducing the overall time loss while maintaining manageable complexity through unified processing logic.
Data Source
AI summary
One or more embodiments of this application provide a property index creation method and apparatus for a graph database, a device, and a storage medium. The method includes: in response to a data import operation for the graph database, importing to-be-stored data specified by the data import operation into the graph database for storage, and determining whether inventory data is stored in the graph database, where the inventory data is data for which a property index corresponding to a property index definition is not created; determining the inventory data and the to-be-stored data as target data if the inventory data is stored in the graph database, or determining the to-be-stored data as the target data if the inventory data is not stored in the graph database; and creating the property index corresponding to the property index definition for the target data based on the property index definition.