Format-Aware File System Decomposing Complex Files Into Logical Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional file systems do not effectively manage complex files by recognizing their internal structures and diverse properties, leading to inefficiencies in storage and retrieval due to treating files as raw byte sequences rather than containers of logical objects.

Innovation Solution

A system and method that decompose complex files into logical objects based on their characteristics, assigning each object to a suitable storage tier in a multi-tier storage array, and maintaining an index for efficient storage and retrieval.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If traditional file systems treat files as raw byte sequences and split them into blocks or extents, then file system design is simplified, but opportunities for improving file system management efficiency are lost

Engineering Contradiction:
Improvefile system design simplicityVSAvoidfile system management efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent segments complex files into multiple logical objects based on their internal structure and characteristics. Each logical object is then independently managed and stored in appropriate storage tiers, enabling differentiated optimization while maintaining overall file integrity. This segmentation approach resolves the contradiction by allowing efficient management of diverse file components without overcomplicating the overall file system design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by treating different portions of a file (logical objects) differently based on their specific characteristics such as access patterns, size, and importance. Each logical object can be assigned to different storage tiers with appropriate performance and cost characteristics, enabling optimized storage management for each portion rather than treating the entire file uniformly.

Inventive Principle:
Principle #3Local quality

2Productivity

If complex files are viewed as containers of smaller logical objects with diverse properties, then storage management efficiency can be improved, but file system design complexity increases

Engineering Contradiction:
Improvestorage management efficiencyVSAvoidfile system design complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary layer (the file system's view of logical objects) between the user/application and the physical storage system. This intermediary translates complex internal file structures into manageable logical objects, allowing efficient storage management without requiring the underlying storage system to understand or handle the complexity of individual file formats and structures.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If files are split into blocks or extents for storage, then storage operations are simplified, but access patterns and performance requirements of internal objects are not addressed

Engineering Contradiction:
Improvestorage operation simplicityVSAvoidperformance requirements fulfillment
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent applies local quality by assigning different storage tiers to different logical objects based on their specific access patterns and performance requirements. Frequently accessed or critical logical objects can be placed in high-performance storage, while less critical objects use standard storage, ensuring that each object's performance needs are met while maintaining simple storage operations.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10558611B2Format aware file system with file-to-object decomposition
Publication Date: 2020.02.11 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10558611B2 patent drawing
  • US10558611B2 patent drawing
  • US10558611B2 patent drawing

AI summary

Embodiments relate to a computer system, computer program product, and method to process complex files, and specifically, to support read and write requests of a multi-object file. Upon receipt of a file, a computer system parses the file into two or more logical objects. Each logical object has an associated or inherent characteristic. Each of the logical objects is matched to a storage tier in a multi-tier storage array. Each logical object is then assigned to a tier based on one or more object characteristics in the matched storage tier, and stored in a decomposed format. In addition, an identification of each logical object, and the object assignment, is recorded in an index.