Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Salient object detection method based on cascade improved network

An object detection and salience technology, applied in the field of image processing, can solve problems such as background interference, and achieve the effect of improving the mode matching ability

Active Publication Date: 2020-03-17
NANKAI UNIV
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the problem of background interference caused by the noise contained in low-level partial features by direct aggregation of features of each level without distinction in the existing RGB-D saliency detection method, and to improve depth features and RGB feature models. Aiming at the problem of state matching ability, a RGB-D salient object detection method based on cascaded improved network is designed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Salient object detection method based on cascade improved network
  • Salient object detection method based on cascade improved network
  • Salient object detection method based on cascade improved network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] refer to figure 1 , the salient object detection method based on the cascaded improved network proposed by the present invention is mainly composed of a depth enhancement unit (DEM) and a cascaded feature decoder (Cascade Decoder), and the salient object detection method based on the cascaded improved network The specific implementation steps are as follows:

[0021] 1. Using two ResNet50 CNN networks with the same architecture, one network inputs RGB images to extract 5 different levels of RGB features. Another network inputs the depth map image to extract 5 different levels of depth features The number of input channels of the RGB network is 3, and the number of input channels of the deep network is 1.

[0022] 2. The five different levels of depth image features extracted in the first step are respectively passed through a depth enhancement module (DEM) to obtain enhanced depth features, and are fused with the RGB features of the corresponding level through eleme...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an RGB-D saliency object detection method based on a cascade improved network, and belongs to the technical field of image processing. Most existing RGB-D models directly aggregate the features from the CNN networks of different levels, and the noise and interference information contained in low-level features are easily introduced. The invention creatively provides a cascade improved structure, a saliency map generated by the features of a high-level part is used as a mask to improve the features of a low-level part, and then a final saliency map is generated by aggregating the improved low-level features. In addition, in order to eliminate the interference information of the depth map, the invention provides a depth enhancement module for preprocessing before thedepth features and the RGB features are mixed. According to the method, four evaluation indexes are used for carrying out experiments on seven data sets, and the results show that the method surpassesall current most advanced RGB-D saliency object detection methods.

Description

technical field [0001] The invention belongs to the technical field of image processing, in particular to an RGB-D salient object detection method based on a cascaded improved network. [0002] technical background [0003] The purpose of RGB-D saliency detection is to combine RGB images with depth information to find the most salient objects in a scene. In recent years, various smart devices capable of capturing depth information (such as smart phones, somatosensory peripherals, etc.) have been popularized and widely used, so a large number of RGB-D saliency algorithms have been proposed. [0004] Early RGB-D saliency detection algorithms mainly used manual features, and these methods greatly relied on specific knowledge, such as local area comparison, global area comparison, background prior knowledge, spatial prior knowledge, and channel prior knowledge. In order to effectively use manual features, researchers have used various classic tools such as support vector machine...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/40G06K9/46
CPCG06V10/30G06V10/56G06V10/462
Inventor 杨巨峰翟英杰范登平
Owner NANKAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products