Machine Learning Repository Service for Pipeline Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Not all programmers and system administrators have the time or knowledge to produce and integrate machine learning models and algorithms into pipelines, hindering their adoption and utilization.

Innovation Solution

A machine learning content repository service that allows producers to share algorithms, models, and data through a registry-based system, enabling requesters to search and build pipelines without generating or training models, using a web services provider with integrated development environments, source control services, and model repositories.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If machine learning models and algorithms are produced and integrated into pipelines by individual programmers and system administrators, then customization and specific task optimization are improved, but the complexity and time required for production and integration increase significantly

Engineering Contradiction:
Improvecustomization capabilityVSAvoidproduction complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a model registry service as an intermediary between model producers and model consumers. This service receives trained machine learning models from producers, stores them in a centralized repository, and makes them available for selection and integration by consumers. This intermediary approach resolves the contradiction by centralizing the complex production and integration tasks, allowing individual programmers to simply select and use pre-trained models without needing to understand the complex training and integration processes.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The model registry service enables self-service by allowing consumers to independently search, select, and integrate machine learning models from the repository without requiring assistance from model producers or complex integration processes. The service automatically handles model storage, versioning, and deployment, enabling users to consume models through simple API calls or graphical interface selections, thus reducing the complexity and time required for model integration.

Inventive Principle:
Principle #25Self-service

2Reliability

If machine learning models are produced and integrated by individual programmers and system administrators, then model-specific optimization is improved, but the time required for production and integration increases

Engineering Contradiction:
Improvemodel optimizationVSAvoidproduction time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by having model producers train and prepare machine learning models in advance, storing them in the model registry with associated metadata including performance characteristics and optimization information. This allows model consumers to select from pre-optimized models without needing to perform time-consuming training and optimization processes themselves, thus maintaining model-specific optimization while dramatically reducing production time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The model registry service acts as an intermediary that bridges the time gap between model production and consumption. It maintains a repository of pre-trained models with optimized performance characteristics, allowing consumers to immediately access and deploy models without waiting for the time-intensive training and optimization processes, thus resolving the contradiction between optimization quality and production time.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If a registry-based system is implemented for sharing machine learning content, then ease of access and utilization is improved, but system complexity increases

Engineering Contradiction:
Improveaccess easeVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The model registry service implements universality by providing a single centralized system that handles multiple functions: model storage, version control, metadata management, model selection, and deployment. This universal service consolidates what would otherwise require multiple separate systems and processes, making the system easier to access and use while managing the underlying complexity internally through a unified interface and standardized protocols.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12067432B2Machine learning repository service
Publication Date: 2024.08.20 AMAZON TECH INC
  • US12067432B2 patent drawing
  • US12067432B2 patent drawing
  • US12067432B2 patent drawing

AI summary

Techniques for providing and servicing listed repository items such as algorithms, data, models, pipelines, and/or notebooks are described. In some examples, web services provider receives a request for a listed repository item from a requester, the request indicating at least a category of the repository item and each listing of a repository item includes an indication of a category that the listed repository item belongs to and a storage location of the listed repository item, determines a suggestion of at least one listed repository item based on the request, and provides the suggestion of the at least one listed repository item to the requester.