Hybrid System Memory-to-Memory Data Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems lack an efficient approach for data communication and storage in hybrid systems, particularly for Web 3.0 applications that require advanced data management and distribution across multiple computing devices.
Innovation Solution
A hybrid system architecture that enables memory-to-memory communication and storage between computing devices, such as a System z server and a cell processor, by determining storage capacity limits and using control signals to manage data distribution based on per stream and total storage limits, employing both push and pull models for data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored locally on a single computing device, then storage speed is improved, but storage capacity is limited by the device's memory limits
Solution Approach 1:
The system segments storage capacity across multiple computing devices in a hybrid system. Each device maintains local storage for speed, while the collective networked devices provide expanded total capacity. Data can be distributed across multiple devices, allowing the system to overcome individual device memory limits while maintaining fast local access.
Solution Approach 2:
The invention transitions from single-dimension local storage to multi-dimensional distributed storage across a network of devices. By adding the network dimension, the system provides both fast local access (original dimension) and expanded remote capacity (new dimension), resolving the contradiction between speed and capacity.
2Quantity of substance
If data is distributed across multiple computing devices, then storage capacity is improved, but communication complexity increases
Solution Approach 1:
The system introduces communication protocols and coordination mechanisms as intermediaries that simplify data distribution across multiple devices. These intermediaries manage the complexity of distributed storage by providing standardized interfaces for data placement, retrieval, and synchronization, reducing the burden on individual devices while enabling expanded capacity.
3Speed
If data is stored on local memory, then access speed is improved, but adaptability to different storage needs is reduced
Solution Approach 1:
The system implements dynamic storage allocation where data can be moved between local and remote storage based on access patterns and requirements. Frequently accessed data remains in fast local memory, while less frequently accessed data is stored remotely. This dynamic approach allows the system to adapt to changing storage needs while maintaining optimal access speeds for active data.
Solution Approach 2:
The hybrid storage system provides universal access to data regardless of its physical location. The system presents a unified storage interface that works whether data is stored locally or remotely, making the storage system adaptable to different access patterns and requirements while maintaining fast access through intelligent data placement.
Data Source
AI summary
The present invention relates to memory to memory communication and storage for hybrid systems. Under the present invention, a data stream is received on a first computing device of a hybrid system. An attempt is made to store the data stream on the first computing device up to a per stream limit and a total storage limit of the first computing device. It is then determined whether to store at least a portion of the data stream on a second computing device of the hybrid system that is in communication with the first computing device. This decision is based on the per stream limit and the total storage limit of the first computing device as well as a per stream limit and a total storage limit of the second computing device. Thereafter, the at least a portion of the data stream and a control signal are communicated to the second computing device for storage.