Name Resolution Service for Simplified Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing tools require users to specify the location, format, and credentials for accessing data, making it complex and inefficient, especially when data sources or formats change.
Innovation Solution
A system that uses a name resolution service to simplify data access by allowing users to request data with an aliased name, which is then resolved to metadata specifying the data source, format, and credentials, enabling seamless access and management without updating user code.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users directly access data using code that specifies location, format, and credentials, then data access functionality is achieved, but code complexity increases and maintenance difficulty increases when data sources change
Solution Approach 1:
The patent introduces a name resolution service as an intermediary between users and data sources. Users provide aliased names (simple identifiers) instead of directly specifying data source details. The name resolution service resolves these aliases to actual data source information (location, format, credentials), thereby simplifying user code while managing the complexity of data source configuration internally.
Solution Approach 2:
The system separates data access functionality into distinct components: (1) user code that uses simple aliased names, (2) a name resolution service that handles the complexity of resolving aliases to data source details, and (3) the actual data sources. This segmentation allows each component to focus on a specific task, reducing overall system complexity and improving maintainability.
2Adaptability or versatility
If data source location or format changes, then data can be updated, but user code must be updated accordingly
Solution Approach 1:
The name resolution service acts as a buffer that absorbs changes in data source configuration. When data source location or format changes, only the name resolution service needs to be updated with new mappings, not the user code. This intermediary layer protects user code from changes in the underlying data infrastructure.
Solution Approach 2:
The system performs name resolution in advance of actual data access. By resolving aliased names to data source details beforehand, the system prepares the connection information that user code will use. This preliminary resolution step isolates user code from changes, as the alias-to-source mapping can be updated independently.
3Measurement precision
If users need to know data specifics (location, format, credentials), then precise data access is achieved, but accessibility and ease of use decrease
Solution Approach 1:
The name resolution service mediates between the simplified alias names used by users and the detailed data source information required for precise access. Users work with high-level aliases for ease of use, while the intermediary ensures that the underlying precise data source details (location, format, credentials) are correctly retrieved and used.
Data Source
AI summary
Systems, methods, devices, and computer readable storage media described herein provide techniques for simplifying data access and management for data computing. In an aspect, a request to load data is received. The request comprises an aliased name associated with the data. A call is transmitted to a name resolution service executing on a computing device. The call comprises the aliased name and is configured to cause the name resolution service to identify the data associated with the aliased name. A response is received from the first resolution service. The response comprises metadata of the data. The data is obtained from a data source based on the metadata. A dataset is generated based on the obtained data. A response to the request is provided. The response comprises the generated dataset. In a further aspect, an application is configured to import a library into a computer program under development.