Data Repartitioning via Redundant Partitions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data storage systems face inefficiencies and downtime during repartitioning processes, particularly as transaction data volume increases, leading to delays and increased costs due to the unavailability of logical partitions and the need for frequent data redistribution.

Innovation Solution

Implementing a system that automatically repartitions data among multiple logical partitions, allowing for efficient data redistribution and maintaining redundancy to ensure continuous service by identifying available memory partitions, deleting data portions, and assigning redundant partitions to maintain data integrity and availability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data storage systems add logical partitions by adding additional computing machines to increase data storage capacity, then the data storage capacity is improved, but the repartitioning process causes logical partitions to be unavailable for memory access, resulting in processing and transaction delays

Engineering Contradiction:
Improvedata storage capacityVSAvoidprocessing and transaction delays
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The system performs preliminary actions by creating redundant partitions before the repartitioning process begins. These redundant partitions are pre-configured and populated with data in advance, so that when repartitioning occurs, the system can immediately switch to using the pre-prepared redundant partitions, avoiding service interruptions and delays during the actual data redistribution process

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of data in redundant partitions that mirror or supplement the primary partitions. These copied data sets are maintained in advance and can be quickly activated during repartitioning operations, allowing the system to maintain service availability while data is being redistributed across the expanded storage capacity

Inventive Principle:
Principle #26Copying

2Stability of the object's composition

If the system performs complete data redistribution during repartitioning to balance data across all partitions, then data balance is improved, but the unavailability of partitions during the process increases, causing service interruptions

Engineering Contradiction:
Improvedata balanceVSAvoidservice availability
Core Design Contradiction:
Stability of the object's compositionVSReliability

Solution Approach 1:

The system performs preliminary population of redundant partitions with data before the repartitioning process. This advance preparation ensures that when repartitioning begins, balanced data distributions are already in place in the redundant partitions, allowing the system to maintain service availability while achieving data balance without complete redistribution interruptions

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The redundant partitions act as intermediaries during the repartitioning process. They serve as temporary data repositories that allow the system to redistribute data across partitions while maintaining continuous service availability, as the intermediaries hold data that can be quickly accessed or migrated without interrupting operations

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the system maintains redundant partitions with complete data copies to ensure service continuity, then service availability is improved, but the storage space required and the time needed to populate redundant partitions increase

Engineering Contradiction:
Improveservice availabilityVSAvoidstorage space
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system applies local quality by making redundant partitions available at specific locations in the partition hierarchy where they are most needed for continuity. Rather than uniformly duplicating all data across all redundant partitions, the system selectively populates redundant partitions with data based on local requirements, reducing overall storage space while maintaining service availability where critical

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses partial action by populating redundant partitions with only the necessary portions of data required for service continuity, rather than complete copies of all data. This selective population reduces the storage space requirement while still providing sufficient redundancy to maintain service availability during repartitioning operations

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10936232B1Methods and apparatus for data repartitioning
Publication Date: 2021.03.02 WALMART APOLLO LLC
  • US10936232B1 patent drawing
  • US10936232B1 patent drawing
  • US10936232B1 patent drawing

AI summary

This application relates to apparatus and methods for automatically determining and providing digital advertisements to targeted users. In some examples, a computing device receives campaign data identifying items to advertise on a website, and generates campaign user data identifying a user that has engaged all of the items on the website. The computing device may then determine a portion of the users based on a relationship between each user and the campaign user data, and may determine user-item values for each of the items for each user of the portion of users, where each user-item value identifies a relational value between the corresponding user and item. The computing device may then identify one or more of the items to advertise to each user of the portion of users based on the user-item values, and may transmit to a web server an indication of the items to advertise for each user.