Universal Storage Handler for Traffic-Spike Data Buffering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face inefficiencies in managing unused storage capacity, leading to wasted resources and the need for additional storage during high traffic periods, while also struggling with processing spikes due to limited bandwidth and query response management.
Innovation Solution
Implementing a universal storage handler that utilizes excess storage capacity across distributed systems for temporary data storage, automatically identifying suitable storage formats and systems, and managing data transfers to optimize storage utilization and processing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If additional storage capacity is provisioned to handle high traffic periods, then storage availability during high traffic periods is improved, but storage resource waste during low traffic periods increases
Solution Approach 1:
The patent implements dynamic storage capacity adjustment by monitoring traffic patterns and automatically provisioning or de-provisioning storage resources based on real-time demand. This allows the storage system to adapt its capacity dynamically, ensuring adequate availability during high traffic periods while releasing resources during low traffic periods to eliminate waste.
Solution Approach 2:
The patent creates a universal storage handler that can serve multiple functions: acting as a primary storage system during normal operations and as a buffer/overflow storage system during high traffic periods. This multi-functional approach allows the same storage infrastructure to handle both regular workloads and traffic spikes without requiring dedicated separate systems.
2Productivity
If data processing bandwidth is increased to handle data spikes, then processing capacity during high traffic periods is improved, but system complexity and cost increase
Solution Approach 1:
The patent implements preliminary buffering of incoming data during low traffic periods, storing excess data in the universal storage handler before the data processing element becomes overwhelmed. This preliminary storage action prevents data loss during traffic spikes without requiring permanent increases in processing bandwidth or system complexity.
Solution Approach 2:
The universal storage handler acts as an intermediary buffer between the data source and the data processing element. It temporarily holds data that exceeds the processing element's bandwidth capacity, allowing the processing element to operate within its fixed bandwidth limits while still handling variable traffic loads effectively.
3Productivity
If unused storage capacity is utilized for temporary data storage, then storage utilization efficiency is improved, but data management complexity increases
Solution Approach 1:
The patent implements self-service mechanisms where the universal storage handler automatically monitors its own capacity, identifies available unused storage space, and autonomously manages the buffering of excess data. This self-managing approach improves storage utilization without proportionally increasing data management complexity, as the system performs these tasks automatically without extensive external intervention.
Data Source
AI summary
Aspects of the present disclosure enable a storage manager to provide access to storage systems of varying types, such as database storage systems or indexed data storage systems, to a data source and allow for use of reserved storage capacity of the storage systems. The storage manager may provide access to storage systems under the control of different cloud storage providers. The storage manager may provide for temporary data storage in a reserved portion of a storage system when processing capacity of a data processing system is exceeded. The storage manager may provide for temporary storage of query results retrieved from a database system in a reserved portion of a data store. The storage manager may provide for temporary storage of data used for data enrichment in a reserved portion of a data store.