Dynamic Validation Rules for Mixed-Schema Data Exchanges
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data exchanges face challenges in validating and executing operations across non-homogenous assets with non-standardized data descriptions, as existing systems are not optimized to transform and validate data descriptions efficiently, leading to inaccuracies and inefficiencies in data quality and processing.
Innovation Solution
Systems and methods generate dynamically tailored validation rules comprising standardized and non-standardized components to validate and execute operations across assets with both standardized and custom schemas, using a first validation rule portion for standardized attributes and a second portion specific to each asset type.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data descriptions are transformed to accommodate diverse data assets, then data exchange capability is improved, but data description standardization deteriorates
Solution Approach 1:
The validation rule is segmented into a standardized portion (applying to all data descriptions) and a custom portion (specific to each asset type). This allows the system to maintain standardization for common validation needs while accommodating asset-specific requirements through the custom portion, thus resolving the contradiction between data exchange capability and data description standardization.
2Measurement precision
If validation rules are created for standardized schemas, then validation accuracy is improved, but applicability to non-standardized schemas deteriorates
Solution Approach 1:
The validation rule is divided into a standardized validation rule portion that ensures accurate validation for standardized schemas and a custom validation rule portion that adapts to non-standardized schemas. This segmentation allows the system to maintain high validation accuracy for standard data while extending applicability to custom data structures.
Solution Approach 2:
The custom validation rule portion is generated specifically for each asset type based on its non-standardized schema, applying local quality validation tailored to the specific data structure requirements. This ensures that validation accuracy is maintained for each asset type's specific schema while the overall system remains applicable to both standardized and non-standardized schemas.
3Adaptability or versatility
If data descriptions are transformed using non-uniform processes, then data flexibility is improved, but validation difficulty increases
Solution Approach 1:
The validation process is segmented into a standardized validation portion that handles common validation tasks uniformly and a custom validation portion that addresses asset-specific requirements. This segmentation reduces overall validation complexity by allowing the standardized portion to handle bulk validation efficiently while the custom portion only processes specific asset types that require additional validation logic.
Data Source
AI summary
Systems and methods use dynamically generated validation rules. These validation rules comprise a first validation rule portion that is generated using a standardized validation process (e.g., corresponding to a standardized schema) and a second validation rule portion that is generated using a validation process selected based on a non-standardized schema that is specific to a respective asset type of the plurality of respective asset types.


