Image semantic segmentation model training method and device, image semantic segmentation method and device and storage medium

A semantic segmentation and model training technology, applied in the field of image processing, can solve the problems of "domain mismatch, poor performance, expensive acquisition of training data, etc., and achieve the effect of improving efficiency and accuracy

Pending Publication Date: 2021-02-02
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

A neural network can be used to build a deep semantic segmentation model. The training of a deep semantic segmentation model requires a large amount of training data with pixel-level annotations. However, obtaining these training data is very expensive and slow
Currently, computer-synthesized images are used in model training, but there is a large difference between computer-synthesized images and real images, which leads to poor performance of semantic segmentation models trained on synthetic images on real images, that is, The phenomenon of "domain mismatch"

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic segmentation model training method and device, image semantic segmentation method and device and storage medium
  • Image semantic segmentation model training method and device, image semantic segmentation method and device and storage medium
  • Image semantic segmentation model training method and device, image semantic segmentation method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the present disclosure are illustrated. The following will clearly and completely describe the technical solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure. Apparently, the described embodiments are only some of the embodiments of the present disclosure, not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present disclosure. The technical solution of the present disclosure will be described in various aspects in conjunction with various figures and embodiments below.

[0045] The "first", "second" and so on in the following are only used to describe the difference, and have no other speci...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an image semantic segmentation model training method and device, an image semantic segmentation method and device, and a storage medium, and relates to the technical field of computers, and the method comprises the steps: carrying out the judgment of a semantic segmentation image generated by a semantic segmentation model through employing a discriminator model; constructinga loss function corresponding to the discriminator model, wherein the loss function comprises a target domain loss function generated based on the target domain image, the target domain loss functioncomprises at least one of a first semantic loss function generated based on semantic consistency of the image blocks, a second semantic loss function generated based on semantic consistency of the clustering clusters and a third semantic loss function generated based on image space logic construction. According to the method and device and the storage medium, the semantic segmentation model reasoning result of the model on the target domain image is constrained in the form of the regularization item in the training process, cross-domain migration is performed on the image semantic segmentation model, and the efficiency and accuracy of image semantic segmentation model training are improved.

Description

technical field [0001] The present disclosure relates to the technical field of image processing, and in particular to an image semantic segmentation model training, an image semantic segmentation method, device and storage medium. Background technique [0002] The goal of image semantic segmentation is to discern the semantic category of each pixel in the image. A neural network can be used to build a deep semantic segmentation model. The training of a deep semantic segmentation model requires a large amount of training data with pixel-level annotations. However, obtaining these training data is very expensive and slow. Currently, computer-synthesized images are used in model training, but there is a large difference between computer-synthesized images and real images, which leads to poor performance of semantic segmentation models trained on synthetic images on real images, that is, The phenomenon of "domain mismatch". Contents of the invention [0003] In view of this...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/11G06K9/62G06N3/04G06N3/08
CPCG06T7/11G06N3/08G06T2207/10004G06T2207/20076G06T2207/20081G06T2207/20084G06N3/045G06F18/2321G06F18/241
Inventor 姚霆梅涛
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products