User-Space File Access Interception to Cut Kernel I/O Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage systems face challenges in optimizing I/O performance due to the rapid expansion of data for large language models (LLMs), necessitating high-speed data access and storage, which results in excessive system overheads and delays.
Innovation Solution
Implementing a user-space file system mounted on a system kernel with process adaptation programs in user-space processes to intercept and manage access requests and results directly in user space, bypassing system kernel calls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If a user-space file system is mounted on a system kernel to enable high-speed data access for LLM tasks, then data access speed is improved, but system overhead increases due to excessive system kernel calls
Solution Approach 1:
The patent extracts the file access functionality from the system kernel to user space by implementing a user-space file system. The process adaptation program intercepts system calls in user space and handles file access operations without requiring actual kernel transitions, thereby maintaining fast access speed while reducing system overhead and energy consumption.
Solution Approach 2:
The process adaptation program acts as an intermediary between the application and the file system. It intercepts system calls using LD_PRELOAD technology and handles file access operations in user space, mediating between the need for fast data access and the reduction of kernel call overhead.
2Reliability
If traditional system call mechanisms are used to access the file system, then system stability is maintained, but access performance deteriorates due to kernel transition overhead
Solution Approach 1:
The patent extracts file access operations from the kernel transition path and implements them entirely in user space. The process adaptation program handles all file system interactions without requiring actual kernel transitions, eliminating the performance bottleneck while maintaining system stability through proven system call interfaces.
Solution Approach 2:
The patent changes the execution context parameter from kernel space to user space for file access operations. By using LD_PRELOAD to intercept and redirect system calls to user-space handlers, the system maintains the stability of traditional system calls while achieving the performance benefits of user-space execution.
Data Source
AI summary
A first process adaptation program is implemented in a first user-space process corresponding to a computing task. A second process adaptation program is implemented in a second user-space process corresponding to a user-space file system. The first process adaptation program intercepts an access request of the first user-space process for the user-space file system and transmits the access request to the second process adaptation program in the user space. The second process adaptation program submits the access request to the second user-space process, intercepts an access result generated by performing access processing on the user-space file system by the second user-space process, and transmits the access result to the first process adaptation program. The first process adaptation program submits the access result to the first user-space process.