The application discloses a
data warehouse layer-by-layer carrying control method based on segmented construction, and relates to the technical field of
data processing.The method comprises the following steps: calling a theme domain ETL log, taking a dependency priority as a constraint, and mining a hierarchical dependency topology; extracting an adjacent
business domain to combine a segmented allocation function to construct an
edge function node; configuring a
data channel according to the hierarchical dependency to form a
processing topology; and K
layers receiving
source data, progressively performing mutual
verification and upward carrying, and outputting a result.The method solves the technical problems that the dependency relationship between business theme domains is complex and lacks hierarchical constraints in the existing
data warehouse ETL
processing process, leading to
chaotic data processing links, easy propagation of errors, and difficulty in guaranteeing
data consistency, and achieves the technical effects of automatically mining business dependency priorities through historical
processing logs, constructing hierarchical dependency topologies and allocating
edge function nodes, realizing mutual
verification of intra-layer data and layer-by-layer carrying of inter-layer data in the processing process, and improving the accuracy, consistency and
automation level of
data processing.