Multiplexed Resource Allocation for Parallel Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computer systems are limited in processing complex data sets due to hardware constraints, such as limited physical space, power, and cooling capabilities, leading to inefficiencies in resource utilization and throughput when relying on single computing devices.
Innovation Solution
A multiplexed resource allocation architecture that breaks down complex data sets and instructions into smaller components, distributing them across multiple devices for parallel processing, allowing for improved resource utilization and higher throughput by assigning instruction segments to suitable resource units and recombining processed segments into a complete data set.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single computing device is used to process complex data sets, then data integrity is maintained, but resource utilization is inefficient and throughput is limited
Solution Approach 1:
The patent divides complex data sets into smaller data segments and distributes them across multiple computing devices. Each device processes a portion of the data independently, then results are aggregated to form the complete processed data set. This segmentation enables parallel processing, significantly improving throughput while maintaining data integrity through coordinated aggregation of results.
2Productivity
If additional hardware resources are installed to increase processing capacity, then throughput improves, but physical space, power, and cooling capabilities are exceeded
Solution Approach 1:
Instead of expanding horizontally by adding more hardware resources to a single device, the patent transitions to a distributed architecture where processing is spread across multiple devices in the network. This dimensional shift from single-device to multi-device processing allows the system to scale throughput without being constrained by the physical limitations of any individual device.
3Loss of time
If a single computing device processes all data, then centralized control is simple, but resource utilization is poor and processing time is excessive
Solution Approach 1:
The patent implements a resource allocation system that monitors the status and availability of multiple computing devices, dynamically assigning data segments to devices based on current resource availability and processing capacity. This feedback mechanism enables efficient resource utilization across the distributed system while maintaining coordinated control, reducing overall processing time without sacrificing operational simplicity.
Data Source
AI summary
A device configured to receive a data set and instructions for processing the data set from a network device. The device is further configured to parse the data set into a plurality of data segments to be processed, and generate a plurality of instruction segments from the received instructions. The device is further configured to assign each instruction segment to a resource unit, and to generate control information with instructions for combining processed data segments from the resource units. The device is further configured to receive processed data segments from the resource units, to generate the processed data set, and to output the processed data set to the network device.