Object Storage Gateway Key-Value Database Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing Ceph system is not stable enough for object storage due to the instability of bucket index objects, which affects all objects in a bucket if the index object malfunctions.
Innovation Solution
An object storage method and gateway that utilizes a key-value storage database, where each storage area is associated with a data table, allowing for independent storage and processing of objects, thereby improving stability and avoiding the impact of a single index object failure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a bucket index object is used to store all objects in a bucket, then object storage can be organized and accessed, but the system stability deteriorates because a single index object failure affects all objects in the bucket
Solution Approach 1:
The patent segments the single bucket index object into multiple object index objects, each responsible for a specific subset of objects in the bucket. This segmentation ensures that a failure in one index object only affects a portion of objects rather than the entire bucket, thereby improving system reliability while maintaining storage organization through distributed indexing.
2Manufacturing precision
If objects are stored in an OSD through serial processing, then data consistency is maintained, but storage efficiency deteriorates due to sequential operation handling
Solution Approach 1:
The patent segments object storage operations into parallel processing streams by distributing different object subsets to different OSDs through the segmented index structure. Each OSD can process objects independently and concurrently, maintaining data consistency within its assigned subset while achieving overall system parallelism and improved storage efficiency.
Solution Approach 2:
The patent introduces dynamic parallel processing capabilities by enabling multiple OSDs to simultaneously handle different object subsets. The system dynamically distributes storage operations across available OSDs based on the segmented index, transforming the static serial processing model into a dynamic parallel architecture that maintains consistency while boosting productivity.
Data Source
AI summary
An object storage method includes: receiving an operation instruction, towards a target object, transmitted by a client terminal of a user; in response to the operation instruction, determining a storage area corresponding to the target object, where the storage area is located in a key-value storage database, the storage area is associated with a data table in the key-value storage database, and storage information of objects in the storage area is recorded in the data table; and processing the target object in the storage area of the key-value storage database according to the operation instruction, and modifying storage information of the target object in the data table according to a result of processing the target object.