Visual Logic Map for Data Extraction Automation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Managing large data sets with hundreds of variables and thousands of data tables is time-consuming and requires technical expertise, often necessitating programmer involvement, and results in code that needs rewriting for different formats and variations among users.

Innovation Solution

A system and method that create a logic map, select an execution language, read metadata, generate intermediate language, compile to code, and execute it in a data management system, allowing users with limited programming knowledge to apply complex rules through a visual authoring tool that generates code in multiple languages and stores rollup variables in a common data table.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If code is manually written to extract data from large data sets, then data extraction can be performed, but it is time-consuming and requires technical expertise

Engineering Contradiction:

Improvedata extraction accuracyVSAvoidcode generation time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system enables non-technical users to perform data extraction themselves through a visual interface without requiring programmer intervention. Users can drag and drop variables and functions to create extraction logic, making the system serve its own user base directly without external technical assistance.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

A visual interface layer acts as an intermediary between users and the underlying code execution system. This interface translates user-friendly drag-and-drop operations into executable code, mediating between simple user actions and complex data extraction operations.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If programmers are enlisted to create extraction code, then data extraction can be performed accurately, but it adds time and cost to making business decisions

Engineering Contradiction:

Improvedata extraction accuracyVSAvoiddecision-making speed

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

Business users can independently perform data extraction operations through the visual interface without requiring programmer assistance. This self-service capability eliminates the need to enlist programmers for routine extraction tasks, enabling faster business decisions.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system replaces the mechanical process of manual code writing and programming expertise with an automated visual interface system. Users interact through intuitive drag-and-drop operations rather than writing code, substituting the mechanical programming process with an automated interface-driven approach.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Ease of manufacture

If code is written for one data format, then data extraction works for that format, but the code needs to be rewritten for other formats

Engineering Contradiction:

Improvecode creation simplicityVSAvoidformat compatibility

Core Design Contradiction:

Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The visual interface and generated code are designed to work across multiple data formats universally. The system handles different formats (CSV, Excel, databases, etc.) through a unified interface, allowing the same extraction logic to operate on various formats without rewriting code.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adapts to different data formats by automatically detecting the input format and adjusting the extraction process accordingly. The code generation process is dynamic, producing format-appropriate code based on the detected data source type without requiring manual reconfiguration.

Inventive Principle:

Principle #15Dynamics

4Ease of operation

If multiple users write variations of similar code, then each user can perform their extraction, but different values are obtained for similar variables

Engineering Contradiction:

Improveuser autonomyVSAvoiddata consistency

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The system provides a universal visual interface that all users employ to perform data extraction. This standardized interface ensures that all users follow the same process and logic structure, eliminating variations in extraction approaches while maintaining user autonomy through the flexible drag-and-drop capabilities.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system enforces homogeneous extraction logic across all users by using a standardized visual interface and generated code structure. All users work with the same variable definitions, functions, and processing logic, ensuring consistent results for similar variables regardless of which user performs the extraction.

Inventive Principle:

Principle #33Homogeneity

Data Source

PatentUS10037194B2Systems and methods for visual data management

Publication Date: 2018.07.31 AMERICAN EXPRESS TRAVEL RELATED SERVICES CO INC

AI summary

An authoring tool may comprise a plurality of predefined functions displayed in a visual manner. A user may select functions from the predefined functions to create a logic map. The authoring tool may read metadata from a metadata store corresponding to the functions. The authoring tool may generate an intermediate language, and compile the metadata from the intermediate language to a desired language. The authoring tool may execute the logic map on data in a data management system.