Method, device and equipment for switching flow batch processing mode of metrological data, storage medium and program product

Abstract

The application relates to a metering data-oriented flow batch processing mode switching method and device, computer equipment, a readable storage medium and a program product, and relates to the technical field of data processing. The application can improve the processing efficiency of a system for metering data. The method comprises the following steps: performing rule matching according to key index information and a rule condition set, counting the triggering times of high-load type rules and low-load type rules according to a rule matching result, and determining the switching direction of a flow processing mode and a batch processing mode according to the triggering times; creating a state snapshot of a current processing mode, obtaining a state change set and a rule triggering state change set according to the state snapshot, and constructing three types of difference sets containing new metering data, the state change set and the rule triggering state change set; and performing gradual task migration based on the three types of difference sets, wherein when the switching direction is switching from the flow processing mode to the batch processing mode, the gradual task migration is performed based on optimal switching parameters.

Images