Shared Pipeline Architecture for Transfer Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data processing pipelines operate independently, making it difficult to incorporate transfer learning in continuous deployment environments, which limits the improvement of model performance.

Innovation Solution

The creation and updating of shared pipelines for data processing, where pipeline information is used to determine similarities and update models such as input, intermediate, or output models, enabling orchestrated training and leveraging transfer learning across multiple tasks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If independent pipelines are used for training and deployment, then automated continuous deployment is achieved, but transfer learning cannot be incorporated

Engineering Contradiction:
Improveautomated continuous deploymentVSAvoidtransfer learning capability
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent merges previously independent training and deployment pipelines into a unified shared pipeline architecture. This allows models to be trained once and shared across multiple deployment pipelines, enabling transfer learning while maintaining automated continuous deployment. The shared pipeline stores trained models that can be reused by multiple downstream applications.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The shared pipeline architecture creates a universal model repository that serves multiple functions: training new models, storing pre-trained models for transfer learning, and providing models to multiple different deployment pipelines. This multi-functional system resolves the contradiction by making the deployment infrastructure adaptable to different use cases while remaining automated.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If separate pipelines are used for each data processing task, then task-specific optimization is achieved, but model performance improvement through transfer learning is limited

Engineering Contradiction:
Improvetask-specific model optimizationVSAvoidmodel performance
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent segments the model lifecycle into distinct components: a shared training pipeline that produces general models, and multiple task-specific deployment pipelines that apply transfer learning. This segmentation allows each component to specialize - the shared pipeline optimizes for general patterns while deployment pipelines optimize for specific tasks, achieving both task-specific optimization and performance improvement through transfer.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The shared pipeline acts as an intermediary between data sources and multiple deployment pipelines. It receives training data, produces trained models, and distributes them to various deployment pipelines. This intermediary structure enables transfer learning by making trained models available as intermediates that can be adapted by multiple downstream tasks.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If transfer learning is incorporated across multiple pipelines, then model performance improves, but pipeline complexity increases

Engineering Contradiction:
Improvemodel performanceVSAvoidpipeline architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The shared pipeline is designed as a universal infrastructure that handles multiple functions: model training, model storage, and model distribution. By creating this universal component, the patent reduces overall system complexity despite enabling transfer learning across multiple pipelines. Instead of each pipeline needing its own training infrastructure, they all share the same universal system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses copying of trained models from the shared pipeline to multiple deployment pipelines. Rather than maintaining complex interconnections between all pipelines, the system copies proven models and adapts them for specific tasks. This copying approach simplifies the architecture by decoupling the training complexity from deployment complexity.

Inventive Principle:
Principle #26Copying

4Manufacturing precision

If manual model training and deployment is performed for each pipeline, then model accuracy can be optimized, but time and resource consumption increase

Engineering Contradiction:
Improvemodel accuracyVSAvoiddeployment efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent combines multiple manual training operations into a single automated shared pipeline. Instead of manually training separate models for each deployment task, the system automatically trains general models in the shared pipeline that can then be transferred and adapted. This merging maintains accuracy through proper transfer learning while dramatically improving deployment efficiency through automation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The shared pipeline performs preliminary model training in advance, creating a repository of pre-trained models before they are needed for specific deployment tasks. This preliminary action allows deployment pipelines to start with pre-trained models rather than training from scratch, significantly reducing time and resource consumption while maintaining the ability to optimize for task-specific accuracy through transfer learning.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11314517B2Method and apparatus for updating pipeline operations for data processing
Publication Date: 2022.04.26 HERE GLOBAL BV
  • US11314517B2 patent drawing
  • US11314517B2 patent drawing
  • US11314517B2 patent drawing

AI summary

Methods described herein relate to updating pipeline operations for data processing. The method includes receiving pipeline information for at least one of a plurality of pipelines. The pipeline information includes at least one of an input dataset, output dataset, input model, intermediate model, or output model. The method also includes determining one or more of the plurality of pipelines to update based on similarities with the pipeline information received for at least one of the plurality of pipelines. The method further includes updating the one or more of the plurality of pipelines based on the pipeline information received. Updating the pipeline includes updating at least one of the input model, intermediate model, or output model. The method still further includes storing the one or more updated pipelines.