Automated XML Data Extraction System for Database Schema Generation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for exporting XML-based data from applications to target databases require pre-mapping of data fields and sharing of administration credentials, which is cumbersome and insecure, and also necessitate a predefined database schema and primary/foreign key relationships.

Innovation Solution

An automated system that transforms XML-based data into a tabular format, intelligently creates primary/foreign keys to associate related data elements, generates database schema scripts, and loads data into target databases without pre-defined schema or key relationships, eliminating the need for manual mapping and credential sharing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If direct export and upload of XML-based data to target databases is implemented, then data transfer efficiency is improved, but the complexity of mapping and credential management increases

Engineering Contradiction:

Improvedata transfer efficiencyVSAvoidmapping and credential management complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically discovering data elements in XML files, generating database schemas, creating mapping relationships, and establishing primary/foreign key connections without requiring manual configuration or shared credentials between source and target systems

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent introduces an intermediary extraction system that acts as a bridge between the XML data source and target database, handling all mapping and credential management complexities internally without requiring direct interaction or credential sharing between the source application and target database administrators

Inventive Principle:

Principle #24Intermediary (Mediator)

2Manufacturing precision

If pre-mapping of data fields is required, then data accuracy is improved, but the time and effort for setup increases

Engineering Contradiction:

Improvedata mapping accuracyVSAvoidsetup time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically discovering all data elements in the XML file structure, pre-generating the database schema, and pre-establishing mapping relationships and primary/foreign key connections before any actual data transfer occurs, eliminating the need for manual pre-mapping configuration

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The extraction system performs self-service by automatically analyzing the XML data structure, intelligently generating appropriate database schemas, and creating accurate mapping relationships without requiring manual intervention or time-consuming setup processes

Inventive Principle:

Principle #25Self-service

3Adaptability or versatility

If administration credentials are shared amongst parties, then data field mapping capability is improved, but security is worsened

Engineering Contradiction:

Improvedata mapping capabilityVSAvoidsecurity

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediary extraction system that handles all data mapping operations internally without requiring shared credentials between source and target systems, eliminating the security vulnerability of credential sharing while maintaining full mapping capability

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs self-service by handling all data field mapping operations autonomously through automatic XML structure analysis and intelligent schema generation, eliminating the need for credential sharing between different parties while maintaining adaptability

Inventive Principle:

Principle #25Self-service

4Stability of the object's composition

If predefined database schema is required, then data organization is improved, but the flexibility to handle new data elements is worsened

Engineering Contradiction:

Improvedata organizationVSAvoidflexibility to handle new data elements

Core Design Contradiction:

Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system implements dynamics by generating database schemas dynamically based on the actual XML data structure rather than using predefined schemas, allowing the schema to adapt automatically to new data elements while maintaining proper organization through intelligent primary/foreign key relationship generation

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS11119990B1Systems for extracting data from XML-based digital process automation and management platforms to databases

Publication Date: 2021.09.14 BANK OF AMERICA CORP

AI summary

Automated end-to-end exporting of XML-based data and uploading in tabular format to target databases. Primary/foreign keys are intelligently created to associate/tie together the hierarchal relationships that exist in the nested XML data. As such, the data can be loaded into the databases while maintaining the requisite hierarchal relationships of the data elements. In addition, the exporting and upload process is independent of target database schema as the invention provides for generating and deploying scripts that define the database schema within the target database.