Compute-Centric Object Store Management via In-Situ Garbage Collection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing cloud-based object storage systems face compatibility issues and inefficiencies due to the use of third-party tools not specifically designed for object store management operations, such as garbage collection and resource metering, leading to challenges in managing multitenant computing environments effectively.

Innovation Solution

The implementation of a compute-centric object store system that transforms object storage dumps into object store tables, generates cleanup tasks, and executes them using reducer containers and cleanup agents, while also partitioning, deduplicating, and aggregating usage records to produce usage reports, thereby enhancing management operations within the object store.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If third-party tools are used for object store management operations, then management functions can be provided, but compatibility issues and operational inefficiencies occur

Engineering Contradiction:

Improvemanagement function compatibilityVSAvoidadministrative burden

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The object store system performs management operations autonomously using its own compute resources. The system executes garbage collection, usage metering, and other management functions directly within the object store environment without requiring external third-party tools, thereby eliminating compatibility issues and reducing administrative burden

Inventive Principle:

Principle #25Self-service

2Productivity

If third-party tools are used for garbage collection and usage metering, then management operations can be performed, but system efficiency and tenant isolation are compromised

Engineering Contradiction:

Improvemanagement operation efficiencyVSAvoidtenant isolation

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system segments management operations into distinct compute tasks that are executed within isolated compute zones. Each tenant's data and management operations are separated into distinct segments, ensuring that garbage collection and usage metering for one tenant do not interfere with another tenant's operations, thereby maintaining reliability and tenant isolation while improving efficiency

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces compute zones as intermediary environments between the object store and management operations. These compute zones act as mediators that execute management tasks in a controlled, isolated manner, preventing direct interference between different tenants' operations while maintaining system-wide efficiency

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9792290B2Object store management operations within compute-centric object stores

Publication Date: 2017.10.17 JOYENT INC

AI summary

Object store management operations within compute-centric object stores are provided herein. An exemplary method may include transforming an object storage dump into an object store table by a table generator container, wherein the object storage dump includes at least objects within an object store that are marked for deletion, transmitting records for objects from the object store table to reducer containers, such that each reducer container receives object records for at least one object, the object records comprising all object records for the at least one object, generating a set of cleanup tasks by the reducer containers, and executing the cleanup tasks by a cleanup agents.