Generic Data Extraction via Metadata Abstraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Business analysts face inefficiencies in accessing and reusing data across disparate databases within enterprises, requiring knowledge of database structures and languages, which diverts their focus from business operations.
Innovation Solution
A generic data extraction method that uses identifiers, data sources, and rules to create metadata for a data extraction element, allowing analysts to reference data as a logical unit independent of its source structure, enabling efficient data acquisition without needing database management skills.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If business analysts directly query databases to acquire data, then data acquisition capability is improved, but the complexity of operation increases and requires specialized technical knowledge
Solution Approach 1:
The patent introduces a data extraction element as an intermediary layer between business analysts and databases. This element encapsulates complex query logic and database structures, allowing analysts to access data through simple, standardized interfaces without needing to understand underlying database complexities. The data extraction element acts as a mediator that translates high-level data requests into detailed database queries automatically.
Solution Approach 2:
The patent segments the data access process into distinct components: data extraction elements that encapsulate specific data access logic, metadata that describes data characteristics, and reusable query templates. This segmentation allows business analysts to work with abstracted data representations while the complex database interaction logic is separated into manageable, reusable units that can be independently developed and maintained.
2Productivity
If business analysts are trained in database management skills, then data acquisition independence is improved, but the opportunity cost of diverting focus from business operations increases
Solution Approach 1:
The patent enables business analysts to independently acquire data through self-service interfaces that do not require specialized database training. The system provides automated tools for defining data extraction elements, selecting data sources, and managing queries. Analysts can independently create, modify, and execute data extraction operations using business-friendly interfaces, eliminating the need for database management training while maintaining data acquisition independence.
Solution Approach 2:
The data extraction element serves as an intermediary that shields business analysts from database complexity. By working with abstracted data representations rather than raw database structures, analysts gain independence in data acquisition without needing to learn database management skills. The intermediary handles the technical complexity while analysts focus on business requirements.
3Reliability
If data is accessed by reconstructing queries each time, then data freshness is improved, but the efficiency of data reuse deteriorates
Solution Approach 1:
The patent implements preliminary action by pre-defining data extraction elements that encapsulate query logic and data access patterns. These pre-configured elements can be reused across multiple data access operations, eliminating the need to reconstruct queries each time. The system maintains data freshness by allowing easy updates to extraction elements while preserving the ability to reuse established query logic for consistent data access.
Solution Approach 2:
The data extraction element is designed as a universal, multi-functional component that can serve multiple data access purposes. A single extraction element can be reused by different analysts, for different queries, and across various applications. This universality improves data reuse efficiency while maintaining the ability to access fresh data by updating the underlying extraction element definitions as needed.
Data Source
AI summary
Techniques are presented for generic data extraction. Metadata defines a data extraction element with reference to an identifier, a data source, and one or more rules. The metadata may be processed to populate the data extraction element when a reference is made within a data template to the identifier. The identifier may be used to import data to a template or to export data to a different template or service.