Distributed Database Data Redistribution Without Temporary Tables

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current online data redistribution methods in relational databases are complex due to the need for data consistency between source and temporary tables, requiring temporary tables, data switching, and resource-intensive processes, which can disrupt user services.

Innovation Solution

A method that determines node sets within a distributed database to migrate data without establishing a temporary table, using intra-table data migration and distributed transactions to reduce complexity and resource consumption, allowing for efficient data redistribution without interrupting user services.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a temporary table is created to implement online data redistribution, then data can be redistributed without interrupting user services, but the complexity of the redistribution process increases due to data consistency requirements and data switching

Engineering Contradiction:
Improveservice continuityVSAvoidredistribution complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the temporary table creation step from the data redistribution process. Instead of creating a temporary table and performing inter-table data migration, the patent directly migrates data within the same table structure, eliminating the need for temporary tables and associated data consistency management

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent merges the data migration process with the table structure itself rather than separating it into temporary table operations. By performing intra-table data migration directly, the patent combines what were previously separate operations (temporary table creation, data copying, data switching) into a single streamlined process

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If inter-table data migration is performed using temporary tables, then online data redistribution can be achieved, but resource consumption increases and efficiency decreases

Engineering Contradiction:
Improveonline redistribution capabilityVSAvoiddata migration efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent removes the temporary table intermediary from the data migration path. By performing direct intra-table migration, the system eliminates the overhead of creating, populating, and switching temporary tables, thereby improving migration efficiency and reducing resource consumption

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of copying data to a temporary table and then switching, the patent copies data directly to its final destination within the same table structure, eliminating the intermediate copying step and associated resource overhead

Inventive Principle:
Principle #26Copying

3Reliability

If data consistency between source and temporary tables is ensured, then data integrity is maintained, but the redistribution process becomes more complex and resource-intensive

Engineering Contradiction:
Improvedata consistencyVSAvoidprocess complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the data consistency management requirement from the context of temporary table operations. By performing migration within the same table, the system maintains data consistency through simpler mechanisms that don't require the complex coordination needed for temporary table data consistency

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent merges data migration with the existing table structure, eliminating the need for separate consistency management between source and temporary tables. The single-table approach inherently simplifies consistency requirements while maintaining data integrity

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11860833B2Data redistribution method, apparatus, and system
Publication Date: 2024.01.02 HUAWEI CLOUD COMPUTING TECHNOLOGIES CO LTD
  • US11860833B2 patent drawing
  • US11860833B2 patent drawing
  • US11860833B2 patent drawing

AI summary

A method includes determining a first node set and a second node set that are in a distributed database and that are separately associated with a first data table, where data in the first data table is stored in the first node set, migrating the data from the first node set to the second node set, receiving, in a process of migrating the data, a target service request for the first data table, determining, in response to the target service request, a third node set in the first node set and the second node set that is configured to respond to the target service request, and sending the target service request to a first data node in the third node set.