Custom Object-In-Memory Format for Data Grid Storage Efficiency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data grid network appliances are inefficient due to their reliance on a mandated portable object format (POF) that requires conversion of native object formats, limiting the use of custom formats like compressed or encrypted formats which could be more efficient.

Innovation Solution

Implementing custom object-in-memory formats in data grid network appliances by maintaining format definitions on client and server devices, allowing objects to be serialized based on these definitions for storage and operations, thereby supporting compressed or encrypted formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a mandated portable object format (POF) is used for storing serialized objects, then format compatibility and portability are improved, but storage efficiency and operation performance deteriorate due to conversion requirements

Engineering Contradiction:

Improveformat compatibilityVSAvoidstorage efficiency

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The system dynamically adapts the serialization format based on the object type and storage requirements. Instead of using a fixed mandated format for all objects, the system can select between mandated POF and custom formats (such as compressed or encrypted formats) depending on the specific needs, thereby improving storage efficiency while maintaining compatibility where required.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent allows changing the format parameters from a fixed mandated structure to flexible custom structures. By permitting custom format definitions that can include compression, encryption, or other optimizations, the system transforms the rigid POF parameter set into adaptable parameters that can be tuned for specific performance requirements.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If a mandated portable object format (POF) is used for storing serialized objects, then format standardization is improved, but operation efficiency deteriorates due to format conversion overhead

Engineering Contradiction:

Improveformat standardizationVSAvoidoperation efficiency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-defining custom format specifications and pre-processing objects into their optimal formats before storage. This avoids the need for format conversion during operations, as objects are already in the appropriate custom format (compressed, encrypted, etc.) when retrieved and used, eliminating conversion overhead and improving operation efficiency.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent creates copies of objects in different formats as needed. Instead of converting the original mandated format objects during operations, the system can maintain or generate copies in custom optimized formats, allowing operations to proceed directly on these copies without conversion time, thereby reducing operational delays.

Inventive Principle:

Principle #26Copying

3Productivity

If custom formats (compressed or encrypted) are used for object serialization, then storage efficiency and security are improved, but format compatibility and portability worsen

Engineering Contradiction:

Improvestorage efficiencyVSAvoidformat compatibility

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The system introduces an intermediary layer (custom format definition and translation mechanism) between the application objects and the storage system. This intermediary allows objects to be stored in efficient custom formats (compressed or encrypted) while maintaining the ability to translate or interpret these formats when needed, thus preserving compatibility without sacrificing storage efficiency. The intermediary handles the format conversion transparently.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10838974B2Custom object-in-memory format in data grid network appliance

Publication Date: 2020.11.17 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Techniques are disclosed for implementing custom object-in-memory formats in a data grid network appliance. The techniques include maintaining a record of format definitions on a client device of the data grid and a corresponding record of format definitions on a server device of the data grid. Each format definition may indicate one or more attributes of an object class and data types and byte ranges of the attributes. The client device may serialize one or more objects for storage in the data grid based on respective format definitions associated with the one or more objects and retrieved from the record of format definitions maintained on the client device. Further, the server device may perform one or more data grid operations using format definitions retrieved from the record of format definitions maintained on the server device.