Semi-Supervised Multi-Task Learning with EMA and Pseudo-Labels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-task learning methods require paired datasets with ground truth for each task, consuming significant time and resources, and have slow convergence rates due to complex training frameworks and large numbers of training parameters.
Innovation Solution
A multi-task learning method utilizing semi-supervised learning with a dataset constructed for each task, employing exponential moving average updates and trainable parameters to concatenate predicted results with input images, reducing training time and improving convergence rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If existing multi-task learning methods use paired datasets with ground truth for each task, then training accuracy can be maintained, but training time and resource consumption increase significantly
Solution Approach 1:
The patent applies preliminary action by pre-processing images to generate pseudo-ground truth labels before training. The system creates synthetic training data with predicted depth maps and segmentation masks as pseudo-labels, which are then used for multi-task learning. This preliminary preparation of training data with ground truth equivalents enables the model to learn multiple tasks simultaneously without requiring expensive paired datasets for each task.
Solution Approach 2:
The patent uses copying by generating synthetic pseudo-ground truth labels that replicate the structure and format of real ground truth data. The system creates copied versions of training images with synthesized depth and segmentation information, allowing the model to practice multiple tasks on replicated data without needing additional real-world annotated datasets for each task.
2Measurement precision
If existing methods train additional modules for each task, then task-specific performance can be improved, but the number of training parameters increases and convergence rate decreases
Solution Approach 1:
The patent applies merging by integrating multiple task-specific modules into a unified multi-task learning framework. Instead of training separate models for each task, the system combines depth estimation, segmentation, and other tasks into a single model that shares common features and learns multiple objectives simultaneously. This consolidation reduces the total number of training parameters while maintaining task-specific performance through multi-objective optimization.
Solution Approach 2:
The patent implements universality by designing a multi-functional model that can perform multiple tasks (depth estimation, segmentation, etc.) simultaneously. The unified architecture uses shared feature extraction layers that serve all tasks, reducing redundancy and parameter count while enabling the model to generalize across different tasks. This multi-functional approach improves convergence rate by eliminating the need to train separate specialized modules for each task.
Data Source
AI summary
A multi-task learning method includes performing a first task in which there is no ground truth for an input image in a multi-task to predict a result of the first task. The multi-task learning method also includes performing at least one task in which there is ground truth with respect to a generation image generated by concatenating the predicted result of the first task and the input image to predict a result of the at least one task. The multi-task learning method additionally includes training the multi-task such that a loss function between the predicted result of the at least one task and ground truth of the at least one task is minimized.


