The application discloses a lottery
data warehouse table data checking method and device based on a sliding window and hierarchical aggregation, a medium and a product, and relates to the field of
data quality management.The method comprises the following steps: defining a checking scheme for a lottery
data warehouse table through configuration information, periodically reading the configuration by a master control program, starting a window checking task when the difference between the
current time and the end time of the window time exceeds the
sedimentation time, and comparing data by window and updating a completion identifier by using the sliding window.The checking task is executed in two
layers: the first layer performs parallel aggregation counting according to units, tables and partitions, and the second layer aggregates source end data and target end data and compares them.If the comparison is successful, the state and the time are updated, and if the comparison fails for a preset number of times, an alarm is given.The application can guarantee
data accuracy and real-time performance, reduce
delay time, improve the stability of the checking process, reduce checking
resource consumption, and flexibly adjust the balance between comparison efficiency and business
delay.