Virtual Storage Device File Priority Mechanism
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern multi-threaded computer systems face challenges in storage virtualization at the block level, leading to performance issues due to difficulty in tying specific operating system or application activities to addressable block ranges, and file-level operations negatively impact system performance, making it hard to provide reliable and efficient data access across storage devices.
Innovation Solution
A storage system with a virtual storage device that allocates data blocks to different storage media tiers based on access frequency, using a block pinning engine to lock frequently accessed data to high-performance storage and relocate it as needed, ensuring optimal performance without user intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If file level operations are used to support accessing data to specific storage data elements, then data accessibility is improved, but overall system performance deteriorates
Solution Approach 1:
The patent introduces a file priority mechanism as an intermediary layer between the file system and storage devices. This mechanism includes a file priority data structure that tracks access patterns and a prioritization engine that uses this information to determine which files should be pinned to specific storage devices. The intermediary translates file-level access requirements into block-level storage operations without requiring direct file system intervention, thus maintaining data accessibility while improving system performance through intelligent data placement
2Productivity
If logical volumes are provided to a plurality of users in a single logical volume to enhance utilization, then storage array utilization is improved, but data accessibility deteriorates due to dispersed critical files
Solution Approach 1:
The patent applies local quality by pinning specific data blocks associated with critical files to particular storage devices based on their access patterns and priority. Instead of uniformly distributing all data across the storage array, the system identifies high-priority files and locally optimizes their placement on specific storage devices that can provide the required performance. This allows the majority of data to remain distributed for high utilization while critical files receive localized high-performance access
3Adaptability or versatility
If block level storage virtualization is implemented in multi-threaded systems, then storage management flexibility is improved, but reliability deteriorates due to difficulty in tying OS activities to addressable block ranges
Solution Approach 1:
The patent implements a feedback mechanism through the file priority data structure that continuously monitors file access patterns, thread activity, and storage device performance. The prioritization engine uses this feedback to dynamically adjust pinning decisions, ensuring that data blocks are pinned to appropriate storage devices based on current system state. This feedback loop maintains reliable data access by adapting to changing multi-threaded workloads while preserving block-level virtualization flexibility
Data Source
AI summary
A method of operation of a storage system includes: establishing a virtual storage device 1 including allocating portions of a storage media 1, a storage media 2, a storage media N, or a combination thereof including writing data blocks to the virtual storage device 1; determining a pinning status for the data blocks; pinning the data blocks to a logical block address (LBA) range until the pinning status indicates an unpinning of the data blocks; and relocating the data blocks to the storage media 1, the storage media 2, the storage media N, or the combination thereof within the virtual storage device 1 when the pinning status indicates unpinned.