Application-Storage Integration via Description Information
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current solutions for running third-generation storage platform applications in flash memory face inefficiencies due to loose coupling between applications and flash memory, leading to high costs, inconsistent performance, and limited scalability, as well as challenges in effectively optimizing data storage.
Innovation Solution
A method and apparatus that optimize data storage by obtaining description information from applications, performing storage functions such as compression, deletion of repetitive data, and transmission via RDMA, to improve integration and efficiency between applications and non-volatile storage devices, thereby reducing processing delays and costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If NoSQL application runs in memory, then high speed is achieved, but scalability is limited to memory capacity and costs increase
Solution Approach 1:
The patent segments the storage system into memory layer and non-volatile storage layer, allowing different types of data to reside in different layers. Hot data remains in memory for high-speed access, while cold data is stored in non-volatile storage, enabling scalability beyond memory capacity while maintaining performance for frequently accessed data.
Solution Approach 2:
The patent introduces a new dimension of storage by adding non-volatile storage alongside traditional memory, creating a hierarchical storage architecture. This dimensional expansion allows the system to scale capacity without sacrificing speed, as the system can operate in both memory and non-volatile storage simultaneously.
2Speed
If NoSQL application runs in memory, then high speed is achieved, but performance becomes inconsistent due to time delay or data loss at downtime and warmup
Solution Approach 1:
The patent implements beforehand cushioning by maintaining data copies in non-volatile storage before memory downtime occurs. This ensures that when memory restarts or experiences downtime, the application can immediately resume operations using data from non-volatile storage, eliminating warmup delays and preventing data loss, thus ensuring performance consistency.
Solution Approach 2:
The patent creates and maintains copies of data in both memory and non-volatile storage. This copying strategy ensures that data is available in multiple locations, so if memory becomes unavailable, the system can retrieve data from non-volatile storage without performance degradation or data loss.
3Adaptability or versatility
If application is adapted for flash memory, then non-volatile storage is utilized, but technology is immature and performance is not validated
Solution Approach 1:
The patent introduces an intermediary layer that manages data between the application and non-volatile storage. This intermediary handles the complexity of flash memory operations, translating application requests into appropriate flash memory operations, thereby insulating the application from the immaturity and complexity of flash memory technology while ensuring reliable performance.
4Adaptability or versatility
If flash memory is integrated as hardware box, then various interfaces and functions are provided, but efficient integration with application is not available
Solution Approach 1:
The patent merges the flash memory storage functionality directly with the application server, creating an integrated system where storage and computation work together seamlessly. This combination eliminates the complexity of external hardware box integration while maintaining all necessary interfaces and functions, as the storage system becomes an integral part of the application infrastructure.
Data Source
AI summary
Embodiments of the present disclosure propose a method and apparatus for optimizing storage of application data. The method comprises obtaining description information for application data from an application; performing storage optimization based on the description information; and performing at least pan of a storage function to be implemented by the back-end storage device, based on the description information before transmitting application data to the back-end storage device. With the method or apparatus according to the embodiments of the present disclosure, an efficient manner of integrating the application and non-volatile storage device is provided to coordinate the application and storage, thereby improving efficiency and expanding capability.