Storage Controller Key-Based Indexing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage devices require multiple data transfers and resource-intensive processing on the host device for indexing operations, leading to increased latency and security risks due to exposure of indexing data.
Innovation Solution
Implementing a data storage device with a controller that performs index searches using a pseudocode file and search key, reducing the load on the host device and enabling parallel processing, while keeping indexing data within the storage device for enhanced security.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If indexing operations are performed on the host device, then data retrieval functionality is achieved, but host device resources are consumed and latency increases
Solution Approach 1:
The storage device performs indexing operations autonomously using its own processor and memory resources, serving itself rather than relying on the host device. The storage device reads index tables from its internal memory, processes search keys, and generates search results independently, thereby freeing host device resources while maintaining reliable data retrieval functionality
Solution Approach 2:
The indexing functionality is segmented from the host device and relocated to the storage device. The storage device is divided into functional components including a processor for executing indexing operations, memory for storing index tables, and interfaces for communication with the host. This segmentation allows the host to focus on higher-level tasks while the storage device handles low-level indexing operations
2Reliability
If multiple data transfers are performed between host device and storage device for indexing, then data access is achieved, but latency increases
Solution Approach 1:
The index tables are extracted from the host device memory and stored locally in the storage device memory. This extraction eliminates the need for repeated data transfers between host and storage device during indexing operations. The storage device reads index tables directly from its own memory, significantly reducing access latency while maintaining data access capability
Solution Approach 2:
The index tables are prepared and stored in the storage device memory in advance, before actual data retrieval operations occur. This preliminary action allows the storage device to perform indexing operations immediately upon receiving a search key, without needing to wait for data transfers from the host device, thereby reducing latency
3Adaptability or versatility
If indexing data is exposed to the host device, then data processing flexibility is improved, but data security deteriorates
Solution Approach 1:
The storage device processor acts as an intermediary between the search key input and the data retrieval process. It processes the search key locally, compares it against index tables stored in its own memory, and generates search results without exposing the indexing data to the host device. This intermediary role maintains data processing flexibility while protecting data security by keeping sensitive indexing data confined within the storage device
Data Source
AI summary
A data storage device includes a non-volatile memory device including one or more memory dies and a controller. The controller is configured to receive a pseudocode file and a search key from one or more external devices and perform an index search based on the received pseudocode and search key. The controller may further determine a data file associated with the performed index search and output the determined data file to the one or more external device.