Container Image File System Layer Access Caching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current container image file systems, such as AUFS and OverlayFS, face performance issues due to inefficient file access and inode consumption, leading to latency and potential inode exhaustion, with no existing solution effectively addressing these problems.
Innovation Solution
A method is introduced where a computer records and shares file system layer access information between different file systems corresponding to the same container image, allowing for optimized file access by preloading large files into memory and reducing the need for layer-by-layer searches, thereby decreasing latency and enhancing performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AUFS implements union mount to unify multiple directories into a single directory view, then file system integration is improved, but file access performance deteriorates due to level-by-level search requirements
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing the merged directory structure and file locations across multiple layers during container image creation. When a container starts, the file system has already prepared the unified view structure, eliminating the need for runtime level-by-level searches and enabling direct file access while maintaining the unified directory interface.
2Quantity of substance
If OverlayFS uses hard links to reference shared data between layers, then storage efficiency is improved, but inode consumption increases leading to inode exhaustion
Solution Approach 1:
The patent applies copying by creating a copy-on-write cache layer that stores file metadata and content references. Instead of using hard links that consume inodes, the system copies essential file information into the cache layer, allowing multiple containers to share the same cached references without incrementing inode counts, thus maintaining storage efficiency while preventing inode exhaustion.
3Adaptability or versatility
If OverlayFS2 uses multiple layers with inodes for file management, then file system functionality is improved, but performance deteriorates due to excessive inode consumption and search overhead
Solution Approach 1:
The patent applies extraction by separating file metadata management from the traditional inode-based layer structure. It extracts essential file access information (paths, permissions, content hashes) and stores them in a dedicated cache layer, removing the burden of inode searches from the multi-layer file system and enabling faster file resolution while preserving the layered functionality.
4Measurement precision
If the file system performs level-by-level search to locate files across multiple layers, then file location accuracy is improved, but access time increases causing latency
Solution Approach 1:
The patent applies preliminary action by pre-computing and storing the complete merged directory structure and file location mappings in the cache layer during container image build time. This allows the file system to directly retrieve file locations from the pre-prepared cache without performing runtime level-by-level searches, maintaining accurate file location information while eliminating search latency.
Data Source
AI summary
File system performance enhancement is provided. Information related to a container of the computer accessing a file in a layer of a file system of an image corresponding to the container is recorded to form recorded file system layer access information. The recorded file system layer access information is shared with another file system of a container image corresponding to a different container on the computer. The container image is a same image as the image corresponding to the container that accessed the file to perform an operation associated with a cloud application.