Key-Value Database Row Identifier Format for Cross-Table Query Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing KeyValue type distributed databases face inefficiencies in cross-table correlated queries due to the management complexity and low query efficiency when handling multiple user data tables with internal correlations, as they are designed for sparse matrix storage and lack efficient mechanisms for querying across tables.

Innovation Solution

The method involves storing correlated data objects in a KeyValue type distributed database using a row identifier format that includes a same column attribute, allowing for consistent row identifier formats across data objects, which facilitates efficient querying by treating multiple data objects as a single table with adjacently stored records, improving data access rates and query efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple user data tables are directly imported into the KeyValue type distributed database, then the database can store massive amounts of data with high scalability, but cross-table correlated query efficiency deteriorates due to excessive small tables and constant data locating

Engineering Contradiction:
Improvedata storage capacityVSAvoidcross-table query efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent merges multiple user data tables into a single unified table by using a consistent row identifier format that includes a common column attribute. This combining approach allows correlated data from different original tables to be stored adjacently in the same table, enabling efficient cross-table correlated queries through a single table scan rather than multiple separate table queries.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If multiple user data tables with different sizes are stored separately, then data storage flexibility is improved, but management complexity increases due to excessive small tables

Engineering Contradiction:
Improvedata storage flexibilityVSAvoidtable management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal table structure that can accommodate multiple user data tables of different sizes by using a consistent row identifier format with a common column attribute. This multi-functional table design allows the system to handle various data types and sizes within a single unified structure, eliminating the need to manage multiple separate small tables while maintaining storage flexibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3023885B1Method and device for storing data
Publication Date: 2019.10.30 HUAWEI TECH CO LTD
  • EP3023885B1 patent drawingFigure 1
  • EP3023885B1 patent drawingFigure 2
  • EP3023885B1 patent drawingFigure 3

AI summary

The present invention discloses a data storage method and apparatus. The method includes: determining a same column attribute of at least two data objects that are to be stored in a KeyValue type distributed database; determining a format of a row identifier, in the KeyValue type distributed database, of each data object in the at least two data objects, where the row identifier format includes the same column attribute and a data object identifier, and data object identifiers of different data objects in the at least two data objects are at a same location in the row identifier format and located after the same column attribute; determining a row identifier value of each data record of each data object according to the determined row identifier format of each data object; and storing the row identifier value of each data record and each data record in the KeyValue type distributed database, where the row identifier value of each data record is used as a primary index, in the KeyValue type distributed database, of each data record. The data storage method and apparatus in embodiments of the present invention can improve data query efficiency.