Accurate Global Event Counting Through Immutable Logs and Deduplication

The system segments the distributed computing system into multiple regions, each with its own event log and counting mechanism. Follower devices within each region process events locally and maintain independent event logs, eliminating the need for continuous replication to a central leader. This segmentation allows parallel processing across regions while reducing replication latency within each region.

Follower devices perform preliminary event processing and counting locally before any potential replication to region leaders. Each follower maintains a local event log and computes counts in advance, so that when replication occurs, the counting work has already been done locally. This preliminary action eliminates waiting for replication before counting can occur.

The patent introduces region leaders as intermediaries between follower devices and the global system. Each region leader receives events from multiple followers within its region, performs deduplication using event identifiers, and maintains a regional event log. This intermediary layer ensures that duplicate events are filtered out at the regional level before propagating upward, preventing overcounting while maintaining distributed processing.

Each follower device maintains a local copy of the event log and performs local counting operations. Instead of relying on a single source of truth, the system creates multiple copies of event data across followers and region leaders, with each copy being independently processed and counted. This copying approach ensures that even if some copies are lost or duplicated during replication, the overall count remains accurate through reconciliation mechanisms.

The counting process is segmented into multiple independent counting operations performed in parallel by different follower devices and region leaders. Each segment processes a subset of events independently, maintaining local accuracy through dedicated counting logic. The final global count is obtained by aggregating these independent segment results, preserving accuracy while enabling parallel execution.

Each follower device and region leader performs self-service counting by maintaining local event logs and computing counts independently without requiring centralized coordination for each counting operation. The system uses self-organizing mechanisms where each component autonomously processes its local events and contributes to the global count, eliminating resource contention and ensuring accuracy through distributed independence.