Proxy Data Table for Native Tabular Structure Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data access technologies face inefficiencies when integrating analysis operations across different programming languages, requiring costly conversions and memory usage, especially for large data sets, due to compatibility bottlenecks between limited-scope APIs and widely used programming languages.
Innovation Solution
A system that allows access to native tabular data structures using a proxy data table, enabling read and write operations without conversion by sharing memory allocations between the underlying data structure and the proxy table, thus allowing operations in any programming language without the need for translation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a data access layer is used to access native tabular data structures from a different programming language, then language compatibility is improved, but memory usage and computational overhead increase due to data copying and conversion
Solution Approach 1:
The patent introduces a proxy data table as an intermediary object that bridges the native tabular data structure and the external programming language. The proxy table shares memory allocation with the native data structure, allowing indirect access without full data copying. This mediator enables language compatibility while minimizing memory overhead by avoiding redundant data storage.
Solution Approach 2:
The proxy data table is nested within or associated with the native tabular data structure through shared memory allocation. The external programming language interfaces with the proxy table, which in turn accesses the native data structure, creating a nested access pattern that reduces the need for complete data duplication and lowers memory requirements.
2Adaptability or versatility
If data is accessed through a data access layer with conversion, then language compatibility is improved, but processing speed decreases due to conversion overhead
Solution Approach 1:
The proxy data table serves as an optimized intermediary that provides direct memory access pathways between the native data structure and the external programming language. By eliminating the need for extensive data conversion operations during read/write operations, the proxy table maintains language compatibility while significantly improving processing speed through direct memory operations.
Solution Approach 2:
Instead of copying entire data structures during access operations, the patent uses shared memory allocation where the proxy table references the native data structure's memory space. This selective copying approach only copies metadata or references rather than complete data records, maintaining compatibility while reducing conversion overhead and improving access speed.
3Quantity of substance
If a proxy data table shares memory allocation with the native data structure, then memory efficiency is improved, but data access complexity increases
Solution Approach 1:
The proxy data table acts as a simplified intermediary layer that abstracts the shared memory complexity from the external programming language. It provides a clean, intuitive interface for data access while managing the underlying shared memory allocation and native data structure interactions, thereby reducing the perceived complexity for users while maintaining memory efficiency.
Data Source
AI summary
In one example, a system can receive, from application code including an analysis operation performed on a set of data, an indication to access the set of data included in a tabular data structure using an application programming interface (API), in which the tabular data structure is associated with a memory allocation and a type. The system can determine that the type of the tabular data structure is the native type, the native type characterizing data structures that are accessed using a first programming language and a second programming language. The system can identify a proxy data table that shares the memory allocation, the proxy data table accessed using the API based on the second programming language. The system can issue one or more read commands to the proxy data table to cause the set of data to be read from the tabular data structure.