Distributed Model Variant State Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for managing distributed data-driven models face challenges such as performance drift, privacy concerns, limited computational resources, model complexity, and plateauing performance due to continuous fine-tuning, especially when deployed across multiple sites with varying data biases and limited access to historical data.

Innovation Solution

A system and method for continuous monitoring of data-driven models that deploy multiple variants of the model across sites, allowing dynamic state management based on performance tracking and historical data, enabling remote updates and adaptive use of variants to maintain performance without sharing sensitive data, and optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If continuous fine-tuning is performed to maintain model performance, then model accuracy is improved, but model complexity increases

Engineering Contradiction:
Improvemodel performanceVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the model management into multiple variants deployed in different states (development, testing, production). Instead of continuously fine-tuning a single model, the system creates separate model variants that can be independently managed and deployed, reducing the complexity of continuous maintenance while maintaining performance through selective deployment of optimized variants.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic state management where model variants can transition between development, testing, and production states based on performance metrics. This dynamic approach allows the system to automatically promote well-performing variants to production without manual intervention, maintaining high performance while reducing operational complexity through automated lifecycle management.

Inventive Principle:
Principle #15Dynamics

2Reliability

If multiple model variants are deployed across sites, then performance drift is reduced, but system complexity increases

Engineering Contradiction:
Improveperformance consistencyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates a universal model variant structure that can be deployed across multiple sites with different data characteristics. The same variant framework serves multiple functions: it can be developed centrally, tested locally at each site, and promoted to production uniformly. This multi-functional approach maintains performance consistency across sites while managing complexity through a standardized deployment mechanism.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements feedback mechanisms where performance metrics from multiple sites are collected and used to determine variant promotion decisions. The system continuously monitors performance drift across sites and uses this feedback to automatically promote variants that maintain consistent performance, thereby reducing performance drift while managing complexity through data-driven automated decisions.

Inventive Principle:
Principle #23Feedback

3Reliability

If incremental updates are applied to maintain models, then performance is maintained, but operational efficiency decreases

Engineering Contradiction:
Improveperformance maintenanceVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent performs preliminary actions by developing and testing model variants before deploying them to production. Variants are fully prepared and validated in development and testing states before being promoted, which eliminates the need for continuous incremental updates once deployed. This preliminary preparation maintains performance while improving operational efficiency by reducing maintenance frequency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements periodic model updates through structured promotion cycles rather than continuous incremental changes. Model variants are developed, tested, and promoted in discrete periodic cycles, which maintains performance consistency while improving operational efficiency by batching updates rather than applying them continuously. This periodic approach reduces the operational burden compared to constant incremental maintenance.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11537952B2Methods and systems for monitoring distributed data-driven models
Publication Date: 2022.12.27 AVICENNA AI
  • US11537952B2 patent drawing
  • US11537952B2 patent drawing

AI summary

A system for monitoring a data-driven model, configured to perform a task in a plurality of sites, includes a plurality of variants of the data-driven model deployed in each site. Each variant is used in one of a plurality of states including a first state wherein the output data of the variant is included in computing a result of the task, and a second state wherein the output data of the variant is excluded from computing the result of the task. A supervision module in each site monitors the plurality of variants, computes the task result based on the output data generated by each variant being used in the first state, and changes, based on the output data generated by variants being used in the first state and in the second state, the use state of a variant from one state to another.