Small object semantic segmentation method combined with object detection

A technology of semantic segmentation and object detection, applied in the field of image processing, can solve the problem of inapplicable small object segmentation, achieve the effect of excellent small object segmentation performance, solve segmentation problems, and improve segmentation accuracy

Active Publication Date: 2019-01-04
NANJING NORMAL UNIVERSITY
View PDF7 Cites 57 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the number of pixels contained in the area where the small target is located is much less than that contained in other targets. When the pixels in the sm...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Small object semantic segmentation method combined with object detection
  • Small object semantic segmentation method combined with object detection
  • Small object semantic segmentation method combined with object detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0035] like figure 1 As shown, a small target semantic segmentation method combined with target detection proposed by the present invention includes the following steps:

[0036] Step 1: Build the DeepLab-Attention semantic segmentation network, that is, combine the DeepLab network model with multi-scale input, and train the network through the dataset to obtain the overall semantic segmentation model.

[0037] The network structure of the overall semantic segmentation image is a semantic segmentation method based on multi-scale input images, and each scale input image is learned by an independent convolutional neural network to obtain pixel-level features. The neural networks at all scales are based on the DeepLab network, which is a semantic segmentation model that partially adjusts the fully convolutional neural network (FCN) structure....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a small target semantic segmentation method combined with target detection. Attention semantic segmentation network, training the network to get the whole semantic segmentationmodel; making small target detection dataset and small target semantic segmentation dataset; training the small target detection network based on YOLOv2 through the small target detection data set; asmall target semantic segmentation network is designed and trained by using the small target semantic segmentation data set to obtain the small target semantic segmentation model. In the testing phase, the test image is used as the input of the whole semantic segmentation model and the small target detection network, and the segmentation result and the small target boundary box of the whole imageare obtained, which is modified by the small target semantic segmentation model. The invention can greatly reduce the segmentation difficulty of the small target, thereby effectively improving the segmentation performance of the small target.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a small target semantic segmentation method combined with target detection. Background technique [0002] Image semantic segmentation is one of the three major tasks of computer vision. Its goal is to classify each pixel in the image and obtain a semantic segmentation map of the image. From the perspective of traditional image segmentation, image semantic segmentation is to segment the image into multiple regions at the semantic level, and then assign appropriate category labels to each region. At present, semantic segmentation has a wide range of applications in autonomous driving, real-time road monitoring, automatic virtual fitting, and medical disease systems. Before the rise of deep learning, the main method of semantic segmentation was to use the conditional random field model to build a probability graph model. In recent years, due to the strong learn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06K9/46G06N3/04
CPCG06V20/41G06V10/44G06N3/045G06F18/214
Inventor 杨明胡太
Owner NANJING NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products