Understanding method of non-parametric RGB-D scene based on probabilistic graphical model

A probabilistic graphical model, RGB-D technology, applied in the field of non-parametric RGB-D scene understanding

Inactive Publication Date: 2015-05-06
ZHEJIANG UNIV
View PDF9 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing scene understanding of RGB-D images is based on parametric methods. How to realize no

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Understanding method of non-parametric RGB-D scene based on probabilistic graphical model
  • Understanding method of non-parametric RGB-D scene based on probabilistic graphical model
  • Understanding method of non-parametric RGB-D scene based on probabilistic graphical model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0079] Image to be detected image 3 Part (a) is processed by the Superparsing (RGB) algorithm and the method of the present invention before and after combining the depth information. It can be seen from the result comparison chart that our method effectively overcomes the problem of insufficient color information on the labeling results under dim light conditions. Influence, achieve a good scene understanding effect.

Embodiment 2

[0081] Image to be detected Figure 4 Part (a) is processed by the Superparsing (RGB) algorithm and the method of the present invention before and after combining the depth information. It can be seen from the result comparison chart that our method effectively reduces the false matching when the colors of different types of objects are similar. After adding depth information, our method effectively overcomes the impact of insufficient color information on the labeling results under insufficient lighting conditions, and achieves a good scene understanding effect.

Embodiment 3

[0083] Image to be detected Figure 5 Part (a) is processed by the Superparsing (RGB) algorithm and the method of the present invention before and after combining the depth information. It can be seen from the result comparison chart that after adding the depth information, our method effectively reduces the number of objects in different categories with similar colors. Mis-matching, achieving a good scene understanding effect.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an understanding method of a non-parametric RGB-D scene based on a probabilistic graphical model. The method comprises the steps of carrying out global feature matching between a marked image and an image marked in a training seat, and building a retrieval set of a similar image of an image to be marked; cutting the image to be marked and the image in the similar image retrieval set, so as to generate super-pixels, and carrying out characteristic extraction on the super-pixels extracted; calculating the proportions of all categories in the training set, building a dictionary of rare categories, and taking the training set and the retrieval set of the similar images as a label source of the image to be marked; carrying out characteristics matching on each super-pixel of the image to be marked and all super-pixels in an image label source; and building a probabilistic graphical model, converting the maximum posterior probability into a minimal energy function by using a Markov random field, and resolving the semantic annotation of each super-pixel of the image to be marked obtained by solving the problem through a graph cutting method. According to the method provided by the invention, the overall and local geometric information can be integrated, and the understanding performance of the RGB-D scene can be improved.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a non-parametric RGB-D scene understanding method based on a probability graph model. Background technique [0002] Scene understanding is to use pattern recognition and artificial intelligence methods to analyze, describe, classify and interpret scene images, and finally obtain the technology of pixel-by-pixel semantic annotation of scene images. It is an important topic of computer vision. It has a wide range of applications in the field of monitoring and network search. [0003] Scene understanding methods are mainly divided into two categories: parametric methods and non-parametric methods. Most of the parametric methods are based on generative models that rely on training, while the non-parametric methods do not need to rely on any training, and transfer semantic labels through the similarity between images. In the parameterized method, it is necessary...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06F17/30
CPCG06V10/462G06F18/23213Y02D10/00
Inventor 费婷婷龚小谨
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap