Database Sync State Management via Dynamic Tombstone Purging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The management of tombstone data in a database is inefficient, as it occupies storage space, increases processing costs, and risks premature purging, leading to incomplete sync state representations on remote devices.
Innovation Solution
A system where a provider maintains a list of changes associated with a sync token, adds tombstones for deleted data, and deletes them only when all consumers are aware of the deletion, ensuring accurate sync state representation without unnecessary storage bloat.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If tombstone data is retained in the database, then sync state accuracy is maintained, but storage space increases and processing costs increase
Solution Approach 1:
The patent implements dynamic tombstone management by tracking consumer sync state and dynamically purging tombstones when no longer needed. The system monitors which consumers have synced with which tombstones and automatically removes them after a predetermined period or when all consumers are caught up, transforming static retention into dynamic, demand-driven retention.
Solution Approach 2:
The system uses feedback from consumer sync requests to determine when tombstones can be safely purged. By tracking which consumers have received which tombstone information and monitoring their sync state, the system gets feedback about actual consumer needs and adjusts tombstone retention accordingly, preventing unnecessary storage while ensuring accuracy.
2Reliability
If tombstone data is retained in the database, then sync state accuracy is maintained, but processing costs increase
Solution Approach 1:
The patent implements dynamic tombstone management by tracking consumer sync state and dynamically purging tombstones when no longer needed. The system monitors which consumers have synced with which tombstones and automatically removes them after a predetermined period or when all consumers are caught up, transforming static retention into dynamic, demand-driven retention.
Solution Approach 2:
The system uses feedback from consumer sync requests to determine when tombstones can be safely purged. By tracking which consumers have received which tombstone information and monitoring their sync state, the system gets feedback about actual consumer needs and adjusts tombstone retention accordingly, preventing unnecessary processing.
3Quantity of substance
If an expiration timer is used to purge tombstones, then storage space is reduced, but sync state holes may occur and network transfer costs increase
Solution Approach 1:
The system uses feedback from consumer sync requests to determine when tombstones can be safely purged. By tracking which consumers have received which tombstone information and monitoring their sync state, the system gets feedback about actual consumer needs and adjusts tombstone retention accordingly, preventing unnecessary processing.
Solution Approach 2:
The patent implements preliminary tracking of consumer sync state before purging tombstones. The system maintains records of which consumers have synced with which tombstones and only purges tombstones after confirming all consumers are caught up, preventing sync state holes before they occur rather than reacting after problems arise.
Data Source
AI summary
Systems and techniques of the management of the metadata of a database are presented. A provider is in communication with a database and a set of consumers of the database. Data may be changed by addition, editing or deletion from the database and such changes are recorded and/or maintained by the provider on a list of changes. The changes on this list may be associated with a sync token. The provider may also maintain a list of consumers and associate with each consumer a last sync token which describes when the last sync request and update on the database was made with the consumer. Data which is deleted from the database is recorded with a tombstone. The tombstone is maintained on the list of changes until all consumers have been made aware of the deletion—then the tombstone may be deleted from the list of changes.