The application discloses a kind of weakly supervised image semantic understanding methods based on multi-
task learning, comprising the following steps: obtaining task missing image, constructing multi-level
task sharing encoder, extracting high-level
semantic information layer by layer, input corresponding decoder
branch;Construct
public space-task space
feature mapping module, through the unaligned task fusion module and task interaction mapping module, update each subtask feature by mapping;Task adaptive feature update module is constructed, and multi-level iterative update unaligned task feature;Task adaptive weakly supervised image semantic understanding framework is constructed, model
loss function is established, image data with task missing is input into model, and obtains multi-task prediction result such as semantic segmentation, depth
estimation, surface normal
estimation.The application is according to the
data information of task
label unaligned, through the mapping interaction of
public space and task space, fully fuses unaligned task feature, iteratively generates high-quality multi-task prediction result, can effectively
handle weakly supervised problem with task missing, and simultaneously improves each task prediction accuracy.