File Record Logging to Prevent Duplicate Active-Active Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Duplicative file processing in active-active systems leads to wastage of computing resources and errors due to unnecessary multiple processing of the same file, which is not addressed by existing technologies.

Innovation Solution

Implement a caching system with a record log to check for existing records before processing files, generating a record indicating the intended region, and waiting for potential changes to prevent duplicate processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If files are processed in active-active systems with multiple nodes, then system resilience and failover capabilities are improved, but duplicative file processing occurs causing waste of computing resources and errors

Engineering Contradiction:

Improvesystem resilienceVSAvoidcomputing resources waste

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The system performs preliminary actions by creating event items in queues and checking for existing records in the record log before processing files. This preliminary checking mechanism prevents duplicative processing by determining whether a file has already been processed or is currently being processed, thereby avoiding waste of computing resources while maintaining system resilience through proper failover handling.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If files are processed in active-active systems with multiple nodes, then system resilience and failover capabilities are improved, but duplicative file processing occurs causing errors

Engineering Contradiction:

Improvesystem resilienceVSAvoidprocessing errors

Core Design Contradiction:

ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary actions by creating event items in queues and checking for existing records in the record log before processing files. This preliminary checking mechanism prevents duplicative processing by determining whether a file has already been processed or is currently being processed, thereby avoiding processing errors while maintaining system resilience through proper failover handling.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses feedback mechanisms through event items in queues and record logs to track the processing status of files. When a file is processed, an event item is created and recorded, providing feedback that prevents other nodes from processing the same file again. This feedback loop ensures that duplicative processing errors are avoided while maintaining the active-active system's resilience capabilities.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS20250227141A1Preventing duplicative file processing

Publication Date: 2025.07.10 CAPITAL ONE SERVICES LLC

AI summary

In some implementations, a device may determine whether an existing record for a file, received at a file storage location, is present in a record log. The device may generate, based on determining that the existing record for the file is not present in the record log, a record for the file in the record log. The record may identify the file and a first region. The device may determine, after generating the record, whether the record has been changed to identify a second region. The device may process the file based on determining that the record has not been changed to identify the second region.