Atomic Counter System for Database Write Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing database systems face performance issues due to high computational loads and slow response times, particularly when performing operations like counting and updating data, which can increase operational costs and degrade user experience.

Innovation Solution

Implementing an atomic counter system that utilizes both volatile and non-volatile memory to efficiently manage data updates by storing counts in RAM and synchronizing with the database only during designated windows or when necessary, reducing the frequency of write operations and alleviating computational stress.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data is stored and retrieved from database using traditional methods, then data can be accessed, but the operation is time consuming and resource intensive

Engineering Contradiction:
Improvedata access speedVSAvoidcomputational resources
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent segments the counter update process into two distinct parts: frequent read operations that can proceed quickly without locking, and less frequent write operations that acquire locks. This segmentation allows the system to optimize for read speed while minimizing the impact of write operations on overall performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary actions by pre-acquiring locks before performing write operations and releasing them afterward. This ensures that write operations are properly synchronized while minimizing the duration of lock holding, thereby reducing their impact on read operations.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If monitoring operations like counters are performed on database, then operational data can be tracked, but response time slows down and operational costs increase

Engineering Contradiction:
Improvemonitoring accuracyVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts the counter monitoring functionality from the critical database path by implementing counters that operate with minimal database interactions. Counters are updated efficiently with lock-free read operations, and write operations are batched and synchronized, removing the performance burden from the main database operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the operational parameters of counter operations by adjusting lock acquisition timing and duration. Locks are acquired only when necessary for write operations and released immediately afterward, changing the temporal parameters of database access to minimize impact on response time.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If frequent write operations are performed to update database, then data is kept current, but computational load increases and performance decreases

Engineering Contradiction:
Improvedata currentnessVSAvoiddatabase throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements periodic action by batching write operations and performing them at scheduled intervals rather than continuously. Counter writes are consolidated and executed periodically, reducing the total number of write operations while maintaining data currentness through efficient synchronization.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent merges multiple write operations into single batched updates. Instead of performing individual write operations for each counter update, the system consolidates changes and applies them together, reducing overhead and improving database throughput.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11550768B1Methods and systems for a fast access database and fast database monitoring
Publication Date: 2023.01.10 AMAZON TECH INC
  • US11550768B1 patent drawing
  • US11550768B1 patent drawing
  • US11550768B1 patent drawing

AI summary

Systems, methods, and computer-readable media are disclosed for an improved database. The systems, methods, and computer-readable media described herein may enhance the response time of databases and improve user experiences. In an example method described herein, a database monitoring system may receive instructions to perform one or more data monitoring operations comprising counting an occurrence of a first value within at least a portion of items stored in a database. The method may include determining a length of a first window of time and fetching, from a first location of a data store of the database, data indicative of a total count of the occurrence of the first value at a time associated with the beginning of the first window of time. In turn, the monitoring system may store data representing the first count in the first memory.