A dynamic data quality checking method and system for an index system
By splitting the query plan and calculating the edit distance and overlap, the pedigree graph is dynamically updated, which solves the problem of false alarms caused by the lag in the pedigree graph and improves the reliability of data quality verification and operational efficiency.
Patent Information
- Application Number
- CN202610655754.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-13
- Publication Date
- 2026-07-17
AI Technical Summary
In existing technologies, the generation and maintenance of pedigree maps rely on periodic offline parsing, which leads to a lag in changes to data processing logic, causing false alarms during quality checks and reducing the reliability and operational efficiency of data quality checks.
By obtaining the query plan of the indicator calculation link, it is divided into calculation segments and mapping segments. The edit distance and overlap of the structure description are calculated, logical changes are determined, and the lineage graph is updated along the downstream dependency path of the lineage graph. Integrity and consistency checks are performed, false alarms are filtered, and a correction report is output.
It enables refined perception and hierarchical judgment of data processing nodes, reduces the update range of lineage maps, improves the reliability of data quality verification and the targeting of operation and maintenance, and eliminates noise interference from logical changes.
Smart Images
Figure CN122412915A_ABST