Multiplexed Logical Disk for High Speed Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional disk storage systems are inadequate for handling high-speed data streaming applications, as they often result in data loss or process anomalies due to their limited throughput, which cannot keep pace with the increasing network speed and the need for parallel distributed processing of large datasets.
Innovation Solution
A high-speed data storage system that utilizes a logical disk implemented from multiple physical disk storage devices, employing a multiplexing scheme to aggregate throughput and enable concurrent read/write operations, allowing for direct, sequential, or advanced search access to data records, thereby overcoming the limitations of individual disk speeds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If conventional disk storage systems are used, then device complexity is low, but data access speed and throughput are insufficient to handle high-speed data streaming applications
Solution Approach 1:
The storage system is segmented into multiple independent physical disk devices that can operate concurrently. Each disk is accessed independently through separate I/O channels, allowing parallel data storage and retrieval operations that aggregate to provide high throughput capability.
Solution Approach 2:
The system transitions from sequential single-disk access to multi-dimensional parallel access by introducing multiple I/O channels and concurrent disk operations. This dimensional expansion enables simultaneous read/write operations across multiple disks, dramatically increasing data access speed.
2Adaptability or versatility
If features such as distributive access, indexed access, and hash access are added to the file system, then data retrieval functionality is improved, but the time necessary to access data rises quickly
Solution Approach 1:
The system performs preliminary actions by pre-calculating and storing access paths for different data retrieval methods (distributive, indexed, hash) before actual data access is needed. This allows the file manager to rapidly select and execute the optimal access path without time-consuming computations during data retrieval operations.
Solution Approach 2:
The file manager dynamically selects the most efficient access method based on real-time conditions and data characteristics. The system adapts its behavior by choosing between sequential, indexed, or hash access paths depending on the query pattern, data distribution, and current system state, optimizing access time for each specific operation.
3Productivity
If asynchronous high speed data adapter receives data continuously, then data throughput is maximized, but data loss or process anomaly occurs when disk storage cannot keep pace
Solution Approach 1:
The storage system segments the data stream into multiple concurrent write operations distributed across multiple disks. Each disk handles a portion of the data stream independently, allowing the system to match high incoming data rates with proportional storage capacity across multiple devices.
Solution Approach 2:
The system maintains continuous data flow by performing concurrent read and write operations on multiple disks simultaneously. The file manager ensures uninterrupted data streaming by overlapping I/O operations, so that data is continuously written to disk without waiting for individual disk operations to complete.
4Reliability
If program waits for disk storage to flush cache before continuing, then data is safely stored, but program execution is blocked and data rate is limited
Solution Approach 1:
The system performs preliminary cache flushing operations before program execution is blocked. By pre-writing data to disk during idle periods or concurrently with other operations, the system ensures data is safely stored without requiring the program to wait, maintaining both safety and productivity.
Solution Approach 2:
The program continues executing without blocking by performing disk write operations concurrently with data processing. The file manager manages overlapping I/O operations so that data writing occurs in the background while the program continues its workflow, eliminating execution blocks and maintaining continuous productivity.
Data Source
AI summary
A high speed data storage system including a logical disk that is implemented from disk systems (i.e., physical disk storage devices and associated controllers) that operate at speed lower than the input data rate. The logical disk supports the input data rate by multiplexing streaming data onto multiple physical disk storage devices. The resulting system has a logical read/write speed that is the sum of each of the disks participated in the storage system. Data written onto the data storage system can be retrieved directly, sequentially, or by means of advanced search techniques such as binary search or skip sequential search.