Administrator Module for Dynamic Processor Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for processing large datasets across multiple processors face inefficiencies due to uneven load distribution, where processors must skip batches of records, leading to additional load and reduced performance.
Innovation Solution
A system and method that utilize an administrator module to allocate records to processors based on timestamps, determining time and record thresholds to ensure uniform load distribution by adjusting the time intervals for each processor according to the time-based distribution of records in the database.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If records are equally allocated amongst a plurality of processors, then uniform load distribution is achieved, but additional load is imposed on processors due to skipping of processed records
Solution Approach 1:
The patent segments the record processing task by dividing records into batches based on timestamp ranges. Each processor is assigned a specific timestamp range, creating discrete segments that can be processed independently without requiring processors to skip records. This segmentation eliminates the skipping overhead while maintaining balanced load distribution.
Solution Approach 2:
The patent dynamically adjusts the time interval allocated to each processor based on the distribution of records across different time periods. The administrator module monitors record timestamps and modifies processor assignments in real-time, ensuring that processors handle proportional shares of the workload without skipping records. This dynamic approach maintains both uniform load distribution and high processor productivity.
2Reliability
If processors skip batches of records processed by previous processors, then record processing order is maintained, but run-time efficiency of the system is affected adversely
Solution Approach 1:
The patent applies preliminary action by pre-organizing records into timestamp-based batches before distribution to processors. The administrator module divides the total record set into contiguous time intervals and assigns each interval to a specific processor in advance. This preliminary organization ensures that processors receive records in the correct chronological order without needing to skip batches during execution, thereby maintaining both processing order and run-time efficiency.
Solution Approach 2:
The administrator module serves as an intermediary that manages the distribution of timestamp-based record batches to processors. It acts as a mediator between the record storage system and the processors, ensuring that each processor receives a contiguous time range without gaps. This intermediary approach maintains record processing order while eliminating the time loss associated with skipping batches.
3Device complexity
If equal time intervals are allocated to each processor, then simple allocation is achieved, but processors handle uneven distribution of records based on time-based distribution
Solution Approach 1:
The patent changes the allocation parameter from fixed equal time intervals to dynamic time intervals based on the actual distribution of records. The administrator module calculates the density of records across different time periods and adjusts the time interval allocated to each processor accordingly. This parameter change ensures that processors handle proportional shares of the workload, improving processing efficiency while maintaining manageable allocation complexity through automated calculation.
Data Source
AI summary
Disclosed is a system and method for management of a task across a plurality of processors, wherein the task processing of a plurality of records. The system includes a plurality of processors and an administrator module. Each of the plurality of processors processes a set of records added in a given time interval and the administrator module determines the time interval for a given processor. The administrator module is operable to receive a timestamp detailing a time when the given record was added to the database arrangement; determine a time period in which the plurality of records were added to the database arrangement; determine a time and record threshold for a given processor; and adjust the time interval allocated to each of the plurality of processors according to the time threshold and the record threshold, based on a time-based distribution of records in the database arrangement.