Composite Data Views for Storage Reliability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current object-based storage systems face challenges in optimizing data access and management, particularly in scaling and efficiency, as they struggle with complex data distribution and redundancy across multiple storage nodes and locations.
Innovation Solution
The implementation of a storage system that utilizes bucket views and a view transition engine layer to manage data access, allowing for filtered views of directories, files, and objects, and enabling data replication and erasure coding to ensure data availability and integrity across multiple storage locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is replicated across multiple storage nodes to improve availability, then system reliability improves, but device complexity and data management difficulty increase
Solution Approach 1:
The patent segments data into objects with independent metadata, allowing each object to be replicated across multiple storage nodes. This segmentation enables fine-grained control over data distribution while maintaining simplicity through object-level operations rather than complex file-level management.
Solution Approach 2:
The patent introduces a view transition engine as an intermediary layer between data access requests and the actual storage nodes. This mediator handles the complexity of data distribution, replication, and routing, shielding users from the underlying storage complexity while ensuring high availability.
2Quantity of substance
If storage capacity is increased to manage growing data needs, then data management capability improves, but system scalability and efficiency challenges increase
Solution Approach 1:
The patent implements dynamic storage capacity management where the system can automatically scale by adding more storage nodes without disrupting existing data access patterns. The view transition engine dynamically routes requests to appropriate storage nodes, maintaining efficiency as capacity increases.
Solution Approach 2:
The patent creates a universal object-based storage interface that can handle various data types and access patterns through a single consistent model. This multi-functionality allows the system to scale capacity while maintaining uniform access efficiency across different data workloads.
3Object-affected harmful factors
If data access security is enhanced through authentication and authorization, then data protection improves, but access complexity and operation difficulty increase
Solution Approach 1:
The view transition engine acts as an intermediary that handles authentication and authorization automatically. Users make simple data access requests without needing to manually manage security credentials, as the mediator translates these requests into secure operations behind the scenes.
Solution Approach 2:
The system implements self-service security where authentication and authorization decisions are automatically applied to data access requests without requiring manual intervention. The view transition engine automatically enforces access control policies, maintaining simplicity while enhancing security.
Data Source
AI summary
A storage system has storage devices and a storage controller that includes a processing device. The processing device is to receive a request for portions of data stored at locations of one or more storage devices. The processing device is to generate a file at a storage device. The file corresponds to a view of the portions of data stored at the locations of the one or more storage devices. The processing device is to identify the portions of data that are stored at the locations of the one or more storage devices. The processing device is to provide the view comprising the portions of data.