Storage Device Direct Data Manipulation via Host Commands
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional file systems are inefficient for bulk data processing and managing large numbers of small files, as they require fetching, modifying, and writing data over a network, leading to processor waste and increased network utilization.
Innovation Solution
A method and system that allows for direct data manipulation on a storage device by issuing commands from a client or server to a storage system, where the commands are executed on the storage device, eliminating the need for data transmission and minimizing processor usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional file systems are used for bulk data processing, then data can be stored and accessed, but processor waste increases and network utilization increases
Solution Approach 1:
The storage device performs data manipulation operations autonomously by executing commands received from the computing device. The storage device reads data, modifies it according to instructions, and writes it back without requiring the computing device to fetch, process, and rewrite the data, thereby eliminating processor waste and reducing network utilization.
2Ease of operation
If data is fetched and modified over the network, then data manipulation can be performed, but network utilization increases
Solution Approach 1:
The storage device acts as an intermediary that receives commands from the computing device and executes data manipulation operations locally. This eliminates the need for data to traverse the network back and forth, significantly reducing network utilization while maintaining the ability to perform data manipulation operations.
3Quantity of substance
If traditional file systems are used, then data can be stored, but bulk data processing becomes inefficient
Solution Approach 1:
The computing device sends commands to the storage device that specify the exact data manipulation operations to be performed. The storage device executes these commands directly on the bulk data without requiring it to be fetched to the computing device, thereby maintaining storage capacity while dramatically improving bulk data processing efficiency.
Data Source
AI summary
A method and system for performing data manipulation on a storage device is disclosed. A data manipulation command is created on a computing device, wherein the computing device is separate from the storage device. The computing device is a client or a server that requests services of a storage system to store data on a storage medium. The computing device and the storage device are connected over a network. The computing device executes a host application, and its data is stored on the medium. The computing device issues a command to the storage device to be performed on the data. The storage device executes the command and sends the result to the computing device. As a result, the data is not sent to the computing device for manipulation.