Semi-Supervised Multi-Task Learning with EMA and Pseudo-Labels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-task learning methods require paired datasets with ground truth for each task, consuming significant time and resources, and have slow convergence rates due to complex training frameworks and large numbers of training parameters.

Innovation Solution

A multi-task learning method utilizing semi-supervised learning with a dataset constructed for each task, employing exponential moving average updates and trainable parameters to concatenate predicted results with input images, reducing training time and improving convergence rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing multi-task learning methods use paired datasets with ground truth for each task, then training accuracy can be maintained, but training time and resource consumption increase significantly

Engineering Contradiction:
Improvetraining accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-processing images to generate pseudo-ground truth labels before training. The system creates synthetic training data with predicted depth maps and segmentation masks as pseudo-labels, which are then used for multi-task learning. This preliminary preparation of training data with ground truth equivalents enables the model to learn multiple tasks simultaneously without requiring expensive paired datasets for each task.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by generating synthetic pseudo-ground truth labels that replicate the structure and format of real ground truth data. The system creates copied versions of training images with synthesized depth and segmentation information, allowing the model to practice multiple tasks on replicated data without needing additional real-world annotated datasets for each task.

Inventive Principle:
Principle #26Copying

2Measurement precision

If existing methods train additional modules for each task, then task-specific performance can be improved, but the number of training parameters increases and convergence rate decreases

Engineering Contradiction:
Improvetask-specific performanceVSAvoidconvergence rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies merging by integrating multiple task-specific modules into a unified multi-task learning framework. Instead of training separate models for each task, the system combines depth estimation, segmentation, and other tasks into a single model that shares common features and learns multiple objectives simultaneously. This consolidation reduces the total number of training parameters while maintaining task-specific performance through multi-objective optimization.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements universality by designing a multi-functional model that can perform multiple tasks (depth estimation, segmentation, etc.) simultaneously. The unified architecture uses shared feature extraction layers that serve all tasks, reducing redundancy and parameter count while enabling the model to generalize across different tasks. This multi-functional approach improves convergence rate by eliminating the need to train separate specialized modules for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250218167A1Multi-task learning method and an apparatus thereof
Publication Date: 2025.07.03 HYUNDAI MOTOR CO LTD
  • US20250218167A1 patent drawing
  • US20250218167A1 patent drawing
  • US20250218167A1 patent drawing

AI summary

A multi-task learning method includes performing a first task in which there is no ground truth for an input image in a multi-task to predict a result of the first task. The multi-task learning method also includes performing at least one task in which there is ground truth with respect to a generation image generated by concatenating the predicted result of the first task and the input image to predict a result of the at least one task. The multi-task learning method additionally includes training the multi-task such that a loss function between the predicted result of the at least one task and ground truth of the at least one task is minimized.