Sparse File System Block Map for Efficient Partial File Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods require recreating entire file systems to access specific files or parts of files, which is an inefficient process, especially when only a portion of a file is needed, as they involve populating and formatting disks with backup files.

Innovation Solution

The creation of a sparse file system and a block map that maps allocated block sectors to corresponding data blocks in a data source, allowing for efficient retrieval of requested blocks without recreating the entire file system, using metadata to allocate block sectors and store mappings between sparse file system sectors and actual data blocks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If entire physical disk is recreated to access files from backing store, then file access can be achieved, but the process becomes onerous and inefficient when only part of a file is needed

Engineering Contradiction:
Improvefile access operationVSAvoidtime to recreate disk
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The invention segments the file system into individual block sectors that can be independently accessed. Instead of recreating the entire disk, the system divides files into discrete blocks and retrieves only the specific blocks needed, allowing partial file access without full system recreation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention extracts only the necessary block sectors from the backing store rather than transferring the entire file system. The block map enables selective extraction of specific blocks corresponding to needed files or file portions, eliminating the need to recreate the complete disk image.

Inventive Principle:
Principle #2Taking out (Extraction)

2Ease of manufacture

If physical disk is partitioned and formatted with backup files, then file system can be accessed, but the process is complex and time-consuming

Engineering Contradiction:
Improvefile system setupVSAvoiddisk partitioning and formatting process
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-creating a block map that records the mapping between block sectors and actual file blocks before access is needed. This pre-computed mapping eliminates the need for real-time disk partitioning and formatting operations when files need to be accessed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of physically copying the entire disk image, the invention creates a virtual copy through the block map structure. This virtual file system representation allows access to backup files without actually replicating the complete physical disk, reducing complexity and time requirements.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If fully populated file system is created for virtual machine, then all files are available, but storage space is wasted and setup time is increased

Engineering Contradiction:
Improvefile system availabilityVSAvoidstorage space consumption
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The invention applies local quality by creating a sparse file system where only the block sectors corresponding to actual files are allocated and mapped. Unallocated sectors remain sparse and do not consume storage space, allowing the file system to adapt to actual file requirements rather than pre-allocating space for all possible files.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes the parameter of file system density from fully populated to sparse. By modifying the allocation status of block sectors to reflect actual file presence, the system reduces storage consumption while maintaining the ability to access files when needed, achieving space efficiency without sacrificing file availability.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9785647B1File system virtualization
Publication Date: 2017.10.10 EFOLDER INC
  • US9785647B1 patent drawing
  • US9785647B1 patent drawing
  • US9785647B1 patent drawing

AI summary

Systems, methods, and media file system virtualization. Exemplary methods may include rendering a sparse file system and creating a block map for the sparse file system. The block map may include a map record for each file record included in the sparse file system. A map record may include extents for blocks associated with a file record, the map record providing a mapping between allocated block sectors for a file record in the sparse file system and corresponding blocks associated with one or more data sources.