Data Expanse Viewer for Database File Addressing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Database management systems face limitations when handling large database files, as they can only address a limited address range, leading to caching requirements and lock management issues, which become problematic as data sizes increase.
Innovation Solution
The implementation of a data expanse viewer that allows a database management system to access and manage large database files by requesting views of the file from the operating system, avoiding the need for caching and enabling access to files beyond the addressable range of the database management system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the database management system caches data in memory, then access speed is improved, but the addressable range is limited to the size of the cache memory
Solution Approach 1:
The patent divides the large database file into multiple segments or partitions that can be independently mapped into the database management system's address space. Each segment can be cached separately, allowing the system to handle files larger than the available memory by processing them in manageable chunks through multiple mapping operations.
Solution Approach 2:
The patent introduces a file mapping layer that adds an abstraction dimension between the physical file and the memory address space. This mapping mechanism allows the system to virtualize the addressable range, enabling access to files larger than physical memory by creating virtual addresses that map to actual file locations on disk.
2Reliability
If the database management system uses locks and test & set operations to manage data control, then data consistency is maintained, but system complexity and overhead increase
Solution Approach 1:
The patent introduces an intermediary mapping layer that acts as a mediator between the database management system and the operating system's file system. This mapping layer handles address translation and data access coordination, reducing the need for complex locking mechanisms by providing a controlled interface that naturally manages concurrent access through its design.
Solution Approach 2:
The file mapping mechanism provides self-service functionality by automatically managing the translation between database addresses and file system addresses. The system handles its own address management and data access coordination through the mapping layer, reducing the burden on external lock management mechanisms.
3Quantity of substance
If the database file size increases beyond the addressable range, then more data can be stored, but the database management system cannot directly address all portions of the file
Solution Approach 1:
The patent introduces a file mapping intermediary that translates between the database management system's address requests and the actual file locations. This mapping layer enables the system to address any portion of a large file by converting logical addresses into physical file offsets, making large files as easy to operate as smaller ones.
Solution Approach 2:
The patent adds a virtual addressing dimension that extends beyond the physical addressable range. By creating a virtual file space that can be larger than physical memory, the system enables addressing of any file size through virtual-to-physical address translation, effectively removing the addressable range limitation.
Data Source
AI summary
Systems and methods for obtaining access to a database file managed by an operating system in a computing system are disclosed. One method includes transmitting a call to an operating system from a database management system, the call requesting access to a database file. The method also includes receiving an address from the operating system at the database management system. The address represents a general address of the database file managed by the operating system. The method further includes transmitting a call to the operating system from the database management system, which includes an address and a size of a view of the database file to be created. The method also includes receiving an address of the view of the database file from the operating system.