Transparent Object Migration Across Storage Tiers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional database systems face limitations in storing diverse types, sizes, and kinds of data, leading to complexity in modifying, correcting, and updating data across multiple storage tiers, which affects performance, security, and ease of use.

Innovation Solution

The implementation of mechanisms and methods for transparent object migration across storage tiers, allowing data to be appended to large data volumes in a multi-tenant store by using a combined data repository with relational and non-relational data store portions, where the CustomEntityOption bit determines storage location, and the application server ensures the database server has an up-to-date copy of the append log and segment metadata for efficient query processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If data is stored in a conventional database system with a single data store, then data access and retrieval are simple and direct, but the system cannot efficiently handle diverse types, sizes, and kinds of data

Engineering Contradiction:
Improvedata storage capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the data storage system into multiple separate data stores, each optimized for specific types of data (e.g., structured data, unstructured data, large objects). This segmentation allows each data store to handle particular data kinds efficiently while the overall system gains versatility through the combination of specialized stores.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If a separate data store is added to handle diverse data types and sizes, then the system can store more kinds of data, but modifying, correcting, and updating the database and data store becomes complex

Engineering Contradiction:
Improvedata storage capabilityVSAvoiddata maintenance ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a pointer or reference mechanism that acts as an intermediary between the database and separate data stores. Instead of directly managing data in multiple stores, the system uses pointers to reference data locations, simplifying maintenance operations. When data needs to be modified, corrected, or updated, operations are performed through these pointers, which automatically route changes to the appropriate data store without requiring complex coordination logic.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If multiple data stores are used to store diverse data, then the system can handle various data types, but user access and data finding become more difficult

Engineering Contradiction:
Improvedata storage capabilityVSAvoiddata access ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The pointer mechanism serves as an intermediary that transparently manages access to data across multiple stores. Users interact with the database through unified queries, and the pointer system automatically resolves these queries to the appropriate data store locations, maintaining ease of access despite the underlying complexity of multiple data stores.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a universal access interface that works across all types of data stores. The pointer mechanism and query system are designed to be multi-functional, handling different data types and storage locations through a single unified interface, so users don't need to know which specific data store contains which data.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11567919B2Methods and systems for performing transparent object migration across storage tiers
Publication Date: 2023.01.31 SALESFORCE INC
  • US11567919B2 patent drawing
  • US11567919B2 patent drawing
  • US11567919B2 patent drawing

AI summary

In accordance with embodiments, there are provided mechanisms and methods for performing transparent object migration across storage tiers. In an embodiment and by way of example, a method for appending data to large data volumes is provided. The method embodiment includes a) setting a CustomEntityOption bit that determines (at object creation time) where the object is stored, either in the relational or the non-relational data store portion, b) loading the CustomEntityOption bit in a cached CustomEntityDefinition, c) showing the CustomEntityOption bit as EntityInfo, and d) allowing custom object definition and Metadata API functionality when the bit is shown.