Distributed Job Processing via Resource Prioritization and Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed processing systems face inefficiencies in utilizing idle processing capabilities from small organizations and individuals due to lack of trust and inability to build cloud service architectures, leading to unsatisfactory job processing performance.
Innovation Solution
A method is introduced to set priorities for processing devices based on their resource availability, allowing for efficient allocation of tasks across cloud and blockchain-based processing systems, reducing communication overhead, and utilizing idle resources effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If idle processing devices from persons and small organizations are connected to provide processing services, then processing capability is expanded, but trust and reliability are insufficient
Solution Approach 1:
The patent merges cloud-based processing systems with blockchain-based processing systems into a unified distributed processing system. This combination allows the system to leverage both the powerful processing capabilities of cloud infrastructure and the trust mechanisms of blockchain technology, thereby expanding processing capability while maintaining reliability through blockchain's inherent trust properties.
Solution Approach 2:
The patent introduces a job manager as an intermediary component that coordinates between different processing systems. The job manager handles task distribution, result collection, and system coordination, enabling seamless integration between cloud and blockchain processing devices while maintaining system reliability through centralized management of the distributed resources.
2Productivity
If cloud-based processing system and blockchain-based processing system work together, then processing resources are utilized more fully, but communication overhead increases
Solution Approach 1:
The patent segments the distributed processing system into distinct cloud-based processing devices and blockchain-based processing devices, each handling specific tasks based on their capabilities and availability. This segmentation allows for optimized task allocation where computationally intensive tasks can be assigned to cloud devices while trust-critical tasks are assigned to blockchain devices, improving overall resource utilization while minimizing unnecessary communication between systems.
Solution Approach 2:
The patent implements dynamic task allocation where the job manager can adaptively assign tasks to different processing systems based on current resource availability, task requirements, and system state. This dynamic approach allows the system to optimize resource utilization in real-time while reducing communication overhead by making intelligent routing decisions that minimize cross-system interactions when not necessary.
Data Source
AI summary
The present disclosure relates to a method, device and computer program product for processing a job. In a method, a first group of tasks in a first portion of the job are obtained, the first group of tasks being executable in parallel by a first group of processing devices. A plurality of priorities are set to a plurality of processing devices, respectively, based on a state of a processing resource of a processing device among the plurality of processing devices in a distributed processing system, the processing resource comprising at least one of a computing resource and a storage resource. The first group of processing devices are selected from the plurality of processing devices based on the plurality of priorities. The first group of tasks are allocated to the first group of processing devices, respectively, which process the first group of tasks for generating a first group of task results.