Computational Storage Data Segmentation for Local Record Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computational storage devices face challenges in efficiently processing and retrieving subsets of data from stored objects, as they often require retrieving entire objects to perform operations, leading to unnecessary data transmission and resource consumption.
Innovation Solution
Implementing a method where data is divided into portions before modification, allowing computational storage devices to perform operations like selection, compression, and encryption locally, and using peer-to-peer communication to manage and reconstruct records across storage devices, reducing data transfer and enhancing processing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If computational storage devices retrieve entire objects to perform operations, then operations can be executed, but bandwidth consumption increases and data transmission efficiency decreases
Solution Approach 1:
The patent segments data objects into multiple data portions before storage. When a computational operation is requested, only the necessary data portions are retrieved and transmitted to the computational storage device, rather than retrieving entire objects. This segmentation enables selective data retrieval, reducing bandwidth consumption while maintaining operational efficiency.
2Productivity
If computational storage devices retrieve entire objects to perform operations, then operations can be executed, but power consumption increases
Solution Approach 1:
By segmenting data into portions and selectively retrieving only necessary segments for computational operations, the system reduces the total data volume processed, thereby lowering power consumption at storage devices while preserving full computational capability.
Solution Approach 2:
The patent extracts and retrieves only the specific data portions needed for computational operations from the stored segments, rather than retrieving entire objects. This extraction approach minimizes energy consumption during data retrieval and processing while maintaining operational effectiveness.
3Adaptability or versatility
If data is divided into portions before storage, then selective data processing is enabled, but device complexity increases
Solution Approach 1:
The patent implements segmentation of data into portions with metadata tracking, enabling selective retrieval and processing. While this increases adaptability and processing flexibility, the complexity is managed through systematic organization of segments and their metadata, allowing the system to handle diverse computational operations efficiently.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3A~3B
AI summary
A method for computational storage may include storing, at a storage device, a first portion of data, wherein the first portion of data may include a first fragment of a record, and a second portion of data may include a second fragment of the record, and appending the second fragment of the record to the first portion of data. The method may further include performing, at the storage device, an operation on the first and second fragments of the record. The method may further include determining that the first portion of data may include a first fragment of a record, and a second portion of data may include a second fragment of the record, wherein appending the second fragment of the record to the first portion of data may include appending, based on the determining, the second fragment of the record to the first portion of data.