Data Store Change Segmentation for Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for propagating state information from a central server to clients face limitations in bandwidth and client processing power, particularly during high-volume data transmission, leading to data backlogs and resource overtaxing, while latest update mechanisms are insufficient for providing event order information.

Innovation Solution

A method that segregates state information changes into event-sequence and latest-update types, further segregating latest updates based on change characteristics like frequency or tendency to change together, and combines these with a publisher/notifier component to package data efficiently, ensuring only current records are transmitted, thus reducing bandwidth and processing demands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all state information changes are transmitted to clients, then clients have complete data, but bandwidth is excessive and client processing is overwhelmed

Engineering Contradiction:

Improvedata completenessVSAvoidbandwidth consumption

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The patent segments state changes into two distinct categories: event-sequence changes (requiring chronological delivery) and latest-update changes (allowing out-of-order delivery). This segmentation allows the system to transmit only necessary data updates rather than all state changes, reducing bandwidth consumption while maintaining data completeness. The segmentation is implemented through a state machine that classifies changes and routes them through appropriate transmission mechanisms.

Inventive Principle:

Principle #1Segmentation

2Loss of information

If event sequence mechanism is used, then event order is preserved, but bandwidth is excessive due to transmitting all changes including obsolete data

Engineering Contradiction:

Improveevent order informationVSAvoidbandwidth consumption

Core Design Contradiction:

Loss of informationVSLoss of energy

Solution Approach 1:

The patent divides state changes into event-sequence changes (where order matters) and latest-update changes (where order doesn't matter). This allows the system to use event-sequence mechanism only for necessary data, while using more efficient latest-update mechanism for other data, thereby preserving event order information where needed while minimizing bandwidth consumption overall.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different transmission mechanisms are applied to different types of data based on their specific requirements. Event-sequence changes receive chronological delivery with order preservation, while latest-update changes use a more efficient mechanism that doesn't guarantee order. This local differentiation optimizes bandwidth usage while maintaining data integrity where required.

Inventive Principle:

Principle #3Local quality

3Loss of energy

If latest update mechanism is used, then bandwidth is reduced, but event order information is lost

Engineering Contradiction:

Improvebandwidth consumptionVSAvoidevent order information

Core Design Contradiction:

Loss of energyVSLoss of information

Solution Approach 1:

The patent segments state changes into event-sequence changes (requiring chronological delivery) and latest-update changes (allowing out-of-order delivery). This segmentation allows the system to use event-sequence mechanism only for necessary data, while using more efficient latest-update mechanism for other data, thereby preserving event order information where needed while minimizing bandwidth consumption overall.

Inventive Principle:

Principle #1Segmentation

4Measurement precision

If all data objects are reported individually, then data precision is maintained, but client processing power is overwhelmed

Engineering Contradiction:

Improvedata accuracyVSAvoidclient processing power

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent merges multiple latest-update data objects into grouped transmissions when they share common characteristics (such as belonging to the same data group or update cycle). This combining reduces the number of individual processing events at the client while maintaining data accuracy, as the client receives consolidated update packets rather than numerous individual change notifications.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS7912949B2Systems and methods for recording changes to a data store and propagating changes to a client application

Publication Date: 2011.03.22 GFI GROUP INC

AI summary

Systems, methods and consumer-readable media for recording changes to a data store and propagating changes to client application. A method according to the invention may include categorizing data into a set of sub-records based on the frequency of change of the data. The method may also include transmitting sub-records of data having a first change frequency to a client application using a latest update process; and transmitting sub-records of data having a second change frequency to a client application using an event sequence process.