Intelligent Storage Medium Task Segmentation for Distributed Computing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed computing systems face inefficiencies in processing data due to the need to move data between central processors and storage media, leading to increased power consumption and processing time, as well as limited system resources.
Innovation Solution
The system employs intelligent storage media with a controller processor and memory, allowing computing tasks to be assigned to either the central processor or the intelligent storage medium based on data amounts, reducing data movement and optimizing resource usage by dividing tasks into chains executed by either processor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is moved between central processors and storage media for processing, then computing tasks can be executed, but power consumption increases and processing time is extended
Solution Approach 1:
The patent divides computing tasks into chains of operations and assigns different segments to different processors (central processor vs. intelligent storage medium controller). This segmentation allows data to be processed in-place at the storage medium without requiring complete data movement to the central processor, thereby reducing power consumption while maintaining processing throughput.
Solution Approach 2:
The intelligent storage medium with its embedded controller processor acts as an intermediary between the central processor and the storage operations. This intermediary can execute computing tasks directly on the storage medium, eliminating the need for data to be continuously moved to the central processor, thus reducing power consumption associated with data transfer while maintaining processing efficiency.
2Productivity
If data is moved between central processors and storage media for processing, then computing tasks can be executed, but processing time is extended
Solution Approach 1:
By segmenting computing tasks into chains and distributing them across the central processor and intelligent storage medium controller, the system enables parallel processing of different task segments. This eliminates sequential data movement delays and reduces overall processing time while maintaining high productivity.
Solution Approach 2:
The intelligent storage medium controller can begin executing computing tasks on data already present in the storage medium without waiting for data to be transferred to the central processor. This preliminary action on stored data eliminates data transfer wait time and reduces total processing time while maintaining processing throughput.
3Device complexity
If computing tasks are assigned to central processors only, then task execution is simplified, but system resources are underutilized
Solution Approach 1:
The patent segments the computing task execution functionality across two processors: the central processor and the intelligent storage medium controller. This segmentation allows both processors to be utilized for computing tasks, improving resource utilization while the scheduler manages the distribution logic to maintain acceptable task assignment complexity.
Solution Approach 2:
The intelligent storage medium controller is designed to perform dual functions: traditional storage control operations and computing task execution. This multi-functionality enables the storage medium to participate actively in processing, improving overall system resource utilization without significantly increasing task assignment complexity due to the scheduler's coordination.
Data Source
AI summary
According to a general aspect, a method may include receiving a computing task, wherein the computing task includes a plurality of operations. The method may include allocating the computing task to a data node, wherein the data node includes at least one host processor and an intelligent storage medium, wherein the intelligent storage medium comprises at least one controller processor, and a non-volatile memory, wherein each data node includes at least three processors between the at least one host processor and the at least one controller processor. The method may include dividing the computing task into at least a first chain of operations and a second chain of operations. The method may include assigning the first chain of operations to the intelligent storage medium of the data node. The method may further include assigning the second chain of operations to the central processor of the data node.


