Saliency object detection method based on Faster R-CNN

A target detection algorithm and target detection technology, which is applied in the field of image saliency detection in computer vision, can solve the problems that the effect of saliency detection is not ideal, and the underlying features cannot extract deep semantic features of images.

Inactive Publication Date: 2018-02-09
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF2 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention is a salient object detection method based on Faster R-CNN, which aims to solve the problem that the deep semantic features of the image cannot be extracted by using the underlying features in the existing saliency detection model, which leads to the unsatisfactory effect of saliency detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Saliency object detection method based on Faster R-CNN
  • Saliency object detection method based on Faster R-CNN
  • Saliency object detection method based on Faster R-CNN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific embodiments.

[0027] The present invention firstly performs multi-scale segmentation on the image, then uses Faster R-CNN to frame possible saliency objects, establishes a similar object map, and then distributes the foreground proportion to superpixels through foreground connectivity, and then uses saliency optimization technology to combine The proportion of foreground and background is used to obtain a smooth and smooth saliency map, and finally the multi-layer cellular automaton is used to fuse to obtain the final saliency map. Specifically include the following steps:

[0028]Step 1: Multi-scale superpixel segmentation. The SLIC superpixel segmentation algorithm is used to segment the input image on three scales. The SLIC superpixel segmentation algorithm...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a saliency object detection method based on Faster R-CNN. The method comprises the steps of first performing multi-scale segmentation on an image, then outlining possible saliency objects using the Faster R-CNN, establishing an object analogue map, thereafter distributing a foreground specific gravity to a superpixel via foreground connectivity, then obtaining round and smooth saliency maps in combination with specific gravities of a foreground and a background using a saliency optimization technology, and at last performing fusion using an MCA (Multi-layer Cellular Automata) to obtain a final saliency map. The segmentation is performed on an input image on three scales using a superpixel segmentation algorithm, and the superpixel segmentation algorithm is to aggregate adjacent and similar pixel points into different sizes of image areas according to low-level characteristics such as a color, a texture and a brightness, such that the complexity of saliency detection can be effectively reduced; and by taking different scales of segmented images as a layer of cells and performing fusion on the different scales of superpixel segmented images using the MCA, theconsistency of an image saliency detection result is guaranteed.

Description

technical field [0001] The invention belongs to the field of saliency detection of images in computer vision, and specifically refers to a saliency detection method for a specific class by deep learning. Background technique [0002] In recent years, with the rapid development of computer, Internet and multimedia technologies, people are exposed to a large amount of image and video information every day in their work and life. Because images and videos contain rich and intuitive content, they are effective channels for people to receive information and are one of the important sources of information, such as online video, video chat, mechanical parts inspection, webcast, intelligent monitoring, etc. Both digital images and videos are growing exponentially, and only using manual processing and analysis of images or videos often has great limitations. As an interdisciplinary subject integrating intelligent information processing and digital analysis, computer vision simulates...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/11G06T7/136G06T7/194G06T7/187
CPCG06T7/11G06T7/136G06T7/187G06T7/194G06T2207/10004
Inventor 王超李静刘铭坚
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products