Dynamic Linker Intercept Library Genomic Data Translation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Contemporary data processing systems, particularly those handling genomic data, face limitations in dynamically modifying a wide variety of data in repositories, such as accessing and processing compressed files and cloud object storage, which hinders versatility and efficiency in computations.
Innovation Solution
A data processing system equipped with a dynamic linker that uses an intercept library to intercept file access operations, enabling the translation of file accesses into virtual files or cloud object-storage access operations, allowing for flexible and dynamic handling of compressed genomic data formats, including just-in-time translation between file formats and conversion to cloud object-storage access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If contemporary data processing systems use standard file access methods to access genomic data in repositories, then the system can access existing data files, but the system lacks flexibility to dynamically modify and translate data in various formats including compressed files and cloud object storage
Solution Approach 1:
The patent introduces a dynamic linker as an intermediary component between the data processing system and the file system arrangement. This dynamic linker includes an intercept library that intercepts file access operations and translates them into virtual file accesses or cloud object-storage access operations, enabling flexible data modification without increasing overall system complexity.
Solution Approach 2:
The patent segments the file access functionality into distinct components: the intercept library that captures file access operations, the translation mechanism that converts operations between different file formats and storage types, and the virtual file system that presents a unified interface. This segmentation allows each component to be optimized independently while maintaining overall system flexibility.
2Adaptability or versatility
If the system implements comprehensive file format translation and cloud storage access, then data versatility is improved, but the complexity of the data processing system increases
Solution Approach 1:
The dynamic linker is designed as a universal component that can handle multiple file formats (including compressed genomic data formats), cloud object storage systems, and local file systems through a single unified interface. This multi-functionality approach allows the system to access and translate various data formats without requiring separate specialized components for each format, thereby improving compatibility while controlling complexity.
3Productivity
If the system uses traditional file access methods, then the system architecture remains simple, but computational efficiency and data transfer speed are reduced
Solution Approach 1:
The intercept library performs preliminary actions by intercepting file access operations before they reach the standard file system interface. This allows the system to pre-process data, translate file formats, and optimize data transfer paths in advance, improving computational efficiency and data transfer speed without requiring complex reorganization of the overall system structure.
Data Source
AI summary
A data processing system includes a data processing arrangement, wherein the data processing arrangement includes computing hardware for executing one or more software products, wherein execution of the one or more software products configures the data processing arrangement to access data from a file system arrangement. The data processing arrangement is operable to load a dynamic linker that is operable to include an intercept library that intercepts file access operations of an executable software product wherein: (i) a virtual file that does not exist on the file system arrangement becomes accessible to the executable software product; (ii) the virtual file is a result of either (a) a just-in-time translation of one or more real files of the file system arrangement, wherein the just-in-time translation is made from one file format to another file format, or (b) conversion of the access operation to an equivalent cloud object-storage access operation(s) on a real object located on the cloud object-storage, or (c) a combination of the just-in-time translation of (a) with the object access conversion from (b). Optionally, at least one of: (iii) the virtual file is a different file format to the real file/object, wherein a compressed file format and the virtual file are mutually different file formats; and (iv) the file formats are genomic file formats.