Database Segment Rebuild Plans Through Deterministic Replica Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing database systems face limitations in processing speed due to hardware constraints, data storage methods, and restricted co-processing options, leading to inefficiencies in handling large volumes of data.
Innovation Solution
A database system architecture that employs a parallelized data input, storage, and processing sub-systems, along with a query and response system, utilizing a segmenting and restructuring approach to optimize data storage and processing across multiple computing devices, enabling efficient and scalable data management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored in a traditional sequential manner in database systems, then hardware constraints are respected, but processing speed is limited
Solution Approach 1:
The patent divides data into multiple segments that can be processed in parallel across different computing devices. Each segment is independently stored and can be accessed simultaneously, thereby increasing processing speed while distributing the hardware load across multiple devices rather than requiring a single complex hardware system
2Productivity
If traditional data storage methods are used, then hardware limitations are accepted, but execution speed is restricted
Solution Approach 1:
The patent transitions from single-device sequential processing to multi-device parallel processing by adding the dimension of distributed computing. Data segments are distributed across multiple computing devices, enabling simultaneous processing operations that dramatically improve execution speed without requiring each individual device to be overly complex
3Productivity
If co-processing options are restricted, then system simplicity is maintained, but processing efficiency deteriorates
Solution Approach 1:
The patent creates a universal data segment format that can be processed by any computing device in the distributed system. Each device can independently process data segments using the same operations, providing multi-functionality and adaptability without requiring complex co-processing arrangements or specialized hardware for each device
4Productivity
If data is not segmented and restructured, then storage simplicity is maintained, but parallel processing capability is lost
Solution Approach 1:
The patent segments data into standardized units that can be independently stored and processed. This segmentation enables parallel processing across multiple devices while maintaining relatively simple storage structures at each individual device level, as each device only needs to handle its assigned segments using uniform operations
Data Source
AI summary
A database system is operable to determine to generate a segment rebuild plan for rebuilding a first segment based on accessing first segment metadata for the first segment. A plurality of replicated part location data is determined for a plurality of parts of the first segment based on processing the first segment metadata and based on applying a deterministic segment part replica dispersal algorithm previously utilized to store the segment group. Nodes of the database system storing a corresponding plurality of sibling parts required to rebuild the plurality of parts of the first segment are determined based on the plurality of replicated part location data and based on storage location-to-node mapping data. The first segment is rebuilt based on applying the segment rebuild plan.