Data Transformation Engine Automating Program Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data transformations are often difficult and time-consuming due to the diverse formats in which data is collected, requiring users to manually search for and apply various transformation operations to achieve a uniform set of data values.
Innovation Solution
A system and method for dynamically generating transformation programs based on example input and output values, using a transformation engine to search for relevant transformation tools, and combining these tools to create ranked transformation programs that can perform desired data transformations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual transformation operations are applied to diverse data formats, then data can be transformed to a uniform format, but the process becomes time-consuming and difficult
Solution Approach 1:
The system enables self-service data transformation by automatically generating transformation programs without requiring manual intervention. The transformation engine autonomously analyzes diverse data formats, identifies appropriate transformation operations, and executes transformations to produce uniform output data, eliminating the need for users to manually search for and apply transformation operations.
Solution Approach 2:
The patent replaces the mechanical manual process of searching for and applying transformation operations with an automated transformation engine. This engine uses algorithmic processes to analyze data formats, select appropriate transformations, and execute them automatically, substituting human manual labor with computational automation.
2Adaptability or versatility
If multiple transformation operations are applied to handle diverse data formats, then comprehensive data transformation is achieved, but the complexity of the transformation process increases
Solution Approach 1:
The transformation engine implements universality by designing a multi-functional system that can handle diverse data formats through a unified transformation framework. The engine incorporates multiple transformation operations (date-time conversions, address parsing, name conversions, etc.) within a single system that automatically selects and applies the appropriate operation based on the input data type, eliminating the need for separate manual processes for each format.
Solution Approach 2:
The patent introduces an intermediary transformation engine that mediates between diverse input data formats and the desired uniform output format. This engine acts as a mediator that automatically analyzes the input data, determines the appropriate transformation operations, and executes them in sequence, simplifying the overall process by hiding the complexity of multiple transformation operations from the user.
3Ease of operation
If users manually search for transformation operations, then specific transformations can be applied, but the effort and time required increases significantly
Solution Approach 1:
The system enables self-service data transformation by automatically generating transformation programs without requiring manual intervention. The transformation engine autonomously analyzes diverse data formats, identifies appropriate transformation operations, and executes transformations to produce uniform output data, eliminating the need for users to manually search for and apply transformation operations.
Solution Approach 2:
The transformation engine performs preliminary action by pre-analyzing the data formats and pre-selecting appropriate transformation operations before the user needs them. The system maintains a library of transformation operations and pre-configures them based on common data formats, so when transformation is needed, the appropriate operation is already identified and ready for execution, eliminating the user's search time.
Data Source
AI summary
Methods, computer systems, computer-storage media, and graphical user interfaces are provided for facilitating data transformations, according to embodiments of the present invention. In one embodiment, a set of example values including example input values that indicate data values to be transformed and example output values that indicate a desired form in which to transform data. Based on the set of example values, a data transformation function that is relevant to the set of example values is identified. The data transformation function is used to generate a transformation program to transform the example input values to the desired form in which to transform data. A suggestion of the transformation program can be provided to a user device, wherein selection of the transformation program suggestion results in a data transformation.