Formula Field Normalization for Cross-Database Schema Consistency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data platform tools face challenges in managing formulas from different remote data sources due to varying syntax and syntax formats, leading to inconsistencies and difficulties in formula evaluation and schema management across diverse databases.
Innovation Solution
A local data platform translates formulas from remote sources into a unified normalized syntax, tracks dependencies, and updates the target database schema to ensure accurate evaluation and maintain closure properties, enabling consistent formula implementation across different data sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If formulas from different remote data sources are directly integrated without normalization, then data diversity and adaptability are maintained, but syntax inconsistencies and evaluation difficulties arise
Solution Approach 1:
The patent introduces a formula normalization service as an intermediary component between remote data sources and the target data platform. This service translates formulas from various source syntaxes into a normalized intermediate representation, enabling consistent evaluation without directly handling syntax inconsistencies from different sources.
Solution Approach 2:
The formula evaluation process is segmented into distinct stages: extraction from remote sources, normalization to a standard format, dependency analysis, and evaluation. This segmentation allows each component to handle specific tasks independently, reducing overall system complexity.
2Manufacturing precision
If formula syntax is normalized to a unified format, then evaluation consistency is improved, but translation complexity and processing time increase
Solution Approach 1:
The system performs formula normalization and dependency analysis in advance during data synchronization, before the formulas need to be evaluated. This preliminary action ensures that formulas are ready for consistent evaluation without adding delays during runtime operations.
Solution Approach 2:
The normalization service creates a copied and translated version of the original formula in the normalized format, preserving the original formula in its source system while maintaining a standardized copy for evaluation purposes.
3Adaptability or versatility
If schema changes are made to accommodate new formulas, then data platform flexibility is improved, but closure properties and formula accuracy may be compromised
Solution Approach 1:
The system implements a feedback mechanism where schema changes are analyzed for their impact on formula closure properties. The dependency analysis component identifies affected formulas and triggers re-evaluation or alerts, ensuring that schema flexibility does not compromise formula accuracy.
Solution Approach 2:
Before applying schema changes, the system performs a preliminary analysis to identify potential impacts on formula closure and accuracy. This allows preventive measures to be taken, such as adjusting the schema change scope or notifying users of potential issues before they occur.
Data Source
AI summary
A processing device may obtain, from a remote data source, a first database formula having a first syntax. The processing device may translate the first database formula to a normalized database formula having a normalized syntax and obtain, from the remote data source, data that is associated with the first database formula. The processing device may update a target database, based on the obtained data and the normalized database formula.