Transformation Graphs for Reusable Evolving Schema Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing schema mapping systems require significant manual effort for users to repeatedly apply identical transformations across multiple datasets, especially when dealing with large numbers of source datasets, without leveraging previous mappings and transformations.
Innovation Solution
A transformation graph system that leverages existing mappings and transformations to suggest optimal paths for mapping new sources by identifying similarities and path cost factors, allowing users to select unified attributes for target schemas dynamically.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users manually specify transformations for each new source attribute, then mapping accuracy can be maintained, but user effort and time consumption increase significantly
Solution Approach 1:
The system performs preliminary actions by automatically analyzing new source attributes and suggesting transformations based on previously established mappings. When a new source attribute is introduced, the system proactively retrieves similar attributes from the transformation history and generates candidate mappings, allowing users to review and approve rather than create from scratch.
Solution Approach 2:
The system copies proven transformation patterns from historical mappings to new source attributes. By storing transformation templates in the transformation history and reusing them for similar attributes, the system replicates successful mappings without requiring users to recreate them, thereby maintaining accuracy while reducing effort.
2Productivity
If the system stores and reuses transformation history, then productivity improves through automation, but system complexity increases
Solution Approach 1:
The system segments the complex task of schema mapping into manageable components: attribute similarity analysis, transformation suggestion generation, and user confirmation. The transformation history is organized into discrete, reusable templates that can be independently selected and applied, making the system's complexity modular and controllable.
Solution Approach 2:
The transformation history acts as an intermediary layer between raw source attributes and target schema mappings. Instead of directly mapping new attributes, the system queries the transformation history for similar patterns, retrieves relevant templates, and presents them as suggestions to users, thereby automating the intermediate analysis step.
3Manufacturing precision
If users review and select from multiple candidate paths, then mapping quality improves, but processing time increases
Solution Approach 1:
The system applies local quality by providing detailed, context-specific transformation suggestions rather than generic options. Each candidate path is tailored to the specific attributes being mapped, drawing from the most relevant sections of transformation history, thereby reducing the number of reviews needed while maintaining high quality.
Solution Approach 2:
The system dynamically adjusts the number and detail level of candidate paths presented based on confidence metrics. When transformation history shows high confidence matches, fewer candidates are presented; when uncertainty is higher, more candidates are shown with additional details, optimizing the review process based on the specific mapping context.
Data Source
AI summary
A system and method of use resolves the frustration of repeated manual work during schema mapping. The system utilizes a transformation graph—a collection of nodes (unified attributes) and edges (transformations) in which source attributes are mapped and transformed. The system further leverages existing mappings and transformations for the purpose of suggesting to a user the optimal paths (i.e., the lowest cost paths) for mapping new sources, which is particularly useful when new sources share similarity with previously mapped sources and require the same transformations. As such, the system also promotes an evolving schema by allowing users to select which unified attributes they want to include in a target schema at any time. The system addresses the technical challenge of finding optimal transformation paths and how to present these to the user for evaluation.