Selective Logging for In-Memory KVS Failure Identification

The patent applies local quality by writing data store logs selectively only for messages that meet specific conditions (e.g., messages stored in data store for longer than a threshold period, or messages with high importance flags), rather than uniformly logging all messages. This selective logging approach maintains reliability for critical messages while reducing the overall log writing overhead and preserving system performance.

The patent implements partial action by performing log writing only for a subset of messages that require enhanced reliability tracking. By applying the logging mechanism partially rather than excessively to all messages, the system achieves adequate data loss prevention for critical operations without the performance penalty of universal logging.

The patent extracts and isolates only the essential log information needed for failure identification, rather than storing comprehensive detailed logs for all messages. By taking out only the critical data elements (such as message identifiers, timestamps, and status indicators) that are necessary for detecting failures, the system maintains effective failure identification capability while significantly reducing log processing time and storage requirements.

The patent applies partial action by collecting and analyzing logs only for messages that meet specific conditions or are suspected of failure, rather than continuously processing comprehensive logs for all messages. This selective log processing approach maintains effective failure detection while minimizing the time and computational resources required for log analysis.

The patent implements feedback mechanisms that actively monitor and compare receiving logs, sending logs, and data store logs to detect discrepancies indicating failures. The selective logging system includes feedback loops that trigger comprehensive log collection and analysis when failure indicators are detected, ensuring that while routine operations benefit from selective logging performance, failure investigation capabilities are maintained through on-demand comprehensive log retrieval and comparison.

The patent applies preliminary action by pre-structuring and storing key log metadata and message identification information even for selectively logged messages. This preliminary organization of essential log data enables efficient failure extent identification when needed, as the foundational log structure is already in place for quick retrieval and comparison, reducing the difficulty of failure analysis despite selective logging.