This invention discloses a customer
group operation method, apparatus, electronic device, and storage medium, relating to the field of internet
data processing technology. The method includes: dynamically setting the number of shards and grouping user data into multiple independently
executable micro-batch task units by assessing
cluster size and resource status. A streaming engine with multiple execution nodes is used to adjust the micro-batch
granularity in real time according to cluster load. Each execution node monitors resource status in real time, calculates a resource busyness coefficient based on the current number of micro-batch task units and estimated
execution time, and dynamically allocates task volume accordingly. In the face of upstream tag
data latency, the
system automatically triggers a tiered degradation strategy, flexibly
cutting non-core tasks, switching to offline tag snapshots, or implementing a fallback strategy based on the latency level and task priority, ensuring the continuity of core business. This invention effectively solves the problems of poor timeliness,
low resource utilization, and lack of effective
disaster recovery mechanisms in existing technologies.