Storage Device Filter for Data Traffic Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage devices face inefficiencies in data extraction and processing due to high data traffic between servers and databases, leading to increased CPU operations and power consumption, especially when handling big data.
Innovation Solution
A data storage device that performs sequential hardware and software filtering, utilizing a filter, CPU, and memory components to analyze and process data pages, with a hardware accelerating logic circuit and DMA controller, reducing data traffic and CPU operations by prioritizing column filtering and using direct memory access for efficient data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If big data is transmitted from database to server for processing, then data extraction can be performed, but data traffic between server and database increases
Solution Approach 1:
The patent extracts the filtering function from the server and implements it in the storage device. The filter unit in the storage device extracts and transmits only the required data to the server, rather than transmitting all big data. This extraction principle reduces data traffic while maintaining data extraction capability.
Solution Approach 2:
The patent performs filtering operations preliminarily in the storage device before data transmission to the server. The filter unit pre-processes the big data by applying filter conditions and only transmits the filtered results. This preliminary action reduces the volume of data that needs to be transmitted and processed by the server.
2Productivity
If processor extracts desired data from big data in main memory, then data extraction is achieved, but CPU operations increase
Solution Approach 1:
The patent extracts the filtering function from the server processor and implements it in dedicated filter hardware in the storage device. This extraction of the filtering function reduces the computational burden on the server CPU, allowing it to focus only on higher-level data processing tasks.
Solution Approach 2:
The patent introduces a filter unit as an intermediary component between the storage medium and the server processor. This intermediary performs preliminary filtering of data, reducing the volume of data that reaches the server CPU and thereby reducing CPU operations and energy consumption.
3Quantity of substance
If hardware filtering is performed in storage device, then data traffic to host is reduced, but device complexity increases
Solution Approach 1:
The patent segments the data processing function by separating the filtering operation from the main storage and server processing. The filter unit is implemented as a separate, dedicated component within the storage device, handling only the filtering task. This segmentation allows for a simpler, more focused implementation of the filtering function rather than requiring a complex general-purpose processing solution.
Solution Approach 2:
The patent introduces a filter unit as an intermediary component between the storage medium and the server processor. This intermediary performs preliminary filtering of data, reducing the volume of data that reaches the server CPU and thereby reducing CPU operations and energy consumption.
Data Source
AI summary
A data storage device includes a filter, a central processing unit (CPU), a first memory configured to store a page, a second memory, and a page type analyzer configured to analyze a type of the page output from the first memory and to transmit an indication signal to the CPU according to an analysis result. According to control of the CPU that operates based on the indication signal, the filter passes the page to the second memory or filters each row in the page, and transmits first filtered data to the second memory.