User-Space File Access Gateway for Low-Overhead I/O
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage systems face challenges in optimizing I/O performance due to the rapid expansion of data for large language models (LLMs), necessitating high-speed data access and storage that results in excessive system overheads and delays.
Innovation Solution
Implementing a user-space file system mounted on a system kernel with process adaptation programs in user-space processes to intercept and manage access requests and results directly in user space, bypassing system kernel calls to optimize access links and reduce overheads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If a user-space file system is mounted on a system kernel to enable high-speed data access for LLM models, then data access speed is improved, but system overhead increases due to excessive system kernel calls
Solution Approach 1:
The patent introduces a user-space gateway process as an intermediary between the computing process and the user-space file system. This gateway intercepts file access requests in user space, performs the actual file operations without involving the system kernel, and returns results directly to the computing process. This intermediary mechanism enables high-speed data access while avoiding the overhead of repeated system kernel calls.
Solution Approach 2:
The patent extracts the file access functionality from the system kernel to user space by implementing a user-space file system with a dedicated gateway process. By taking out the file operation logic from kernel space and placing it in user space, the system eliminates the need for frequent context switches and system calls, thereby reducing system overhead while maintaining fast access speeds.
2Quantity of substance
If a user-space file system is mounted on a system kernel to store LLM model data, then storage capacity is improved, but access performance deteriorates due to system kernel call overhead
Solution Approach 1:
The user-space gateway acts as an intermediary that handles all file access operations in user space. It intercepts access requests from computing processes, performs read/write operations on the user-space file system mounted on the kernel, and returns results without requiring the computing process to make system calls. This maintains storage capacity while dramatically improving access performance.
Solution Approach 2:
The patent segments the file access functionality into a separate user-space gateway process that operates independently from the system kernel and computing processes. This segmentation allows the gateway to handle file operations in user space using efficient memory operations, avoiding the performance penalty of kernel-space transitions while preserving the mounted file system's storage capacity.
3Loss of energy
If process adaptation programs are implemented in user-space processes to intercept access requests, then access overhead is reduced, but system complexity increases
Solution Approach 1:
The patent introduces a user-space gateway process as an intermediary that centralizes file access logic. Rather than modifying multiple computing processes to include adaptation programs, the gateway intercepts requests through shared memory or inter-process communication mechanisms. This approach reduces access overhead while containing system complexity within a single dedicated process rather than scattering it across multiple processes.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A file access method is applied to a computing node for executing a computing task. A user-space file system that runs in user space is mounted on a system kernel of the computing node. A first process adaptation program is implemented in a first user-space process corresponding to the computing task. A second process adaptation program is implemented in a second user-space process corresponding to the user-space file system. The method includes: The first process adaptation program intercepts an access request of the first user-space process for the user-space file system; the first process adaptation program transmits the access request to the second process adaptation program in the user space, and the second process adaptation program submits the access request to the second user-space process; and the second process adaptation program intercepts an access result generated by performing access processing on the user-space file system by the second user-space process, and transmits the access result to the first process adaptation program in the user space, and the first process adaptation program submits the access result to the first user-space process.