Distributed Database Data Replicas for Query Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for processing multi-dimensional data in distributed databases require significant computing resources, which becomes a challenge as the amount of data processed increases, necessitating a method to enhance efficiency without additional resource consumption.

Innovation Solution

The method involves creating multiple data replicas by sorting database data according to specific attributes, generating row keys, and storing these sorted data replicas on different computing nodes, along with creating indices for each replica based on its row key, to improve query efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing techniques for processing multi-dimensional data are applied, then query efficiency is improved, but computing resource consumption increases significantly

Engineering Contradiction:
Improvequery efficiencyVSAvoidcomputing resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by pre-sorting database data according to different data attributes before storage, and pre-generating row keys based on these sorted attributes. This preprocessing ensures that when queries are executed, the data is already organized in an optimal manner, eliminating the need for resource-intensive sorting operations during query execution and thereby improving query efficiency without increasing computing resource consumption

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the database data into multiple data replicas, where each replica is sorted according to different data attributes. By dividing the data into distinct segments with different sorting orders, the system can efficiently handle various types of queries by selecting the appropriate replica, thus improving query efficiency without requiring additional computing resources for real-time data organization

Inventive Principle:
Principle #1Segmentation

2Productivity

If data is sorted and indexed according to multiple attributes, then multi-dimensional query performance is enhanced, but system complexity increases

Engineering Contradiction:
Improvemulti-dimensional query performanceVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates multiple copies of the database data, known as data replicas, where each replica is sorted according to different data attributes. Instead of maintaining a single complex data structure, the system uses multiple simpler copies with different organizational patterns. This approach enhances multi-dimensional query performance by allowing selective access to the most appropriate replica, while keeping each individual replica's structure relatively simple and manageable

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10628449B2Method and apparatus for processing database data in distributed database system
Publication Date: 2020.04.21 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10628449B2 patent drawing
  • US10628449B2 patent drawing
  • US10628449B2 patent drawing

AI summary

A system, method and computer program product configured for processing database data in a distributed database system, wherein the distributed database system comprises a plurality of computing nodes communicatively coupled via computer networks, the method comprising: creating a plurality of different data replicas wherein each of the data replicas is created in the following way: sorting the database data according to at least one data attribute; generating a row key based on the at least one data attribute; and using the sorted database data with the row key as the data replica, storing different data replicas in different computing nodes; and creating an index for each of the data replicas according to its row key.