Method and system for realizing combined semantic hierarchical connection model based on panoramic area scene perception

A scene-aware and regional technology, applied in biological neural network models, character and pattern recognition, instruments, etc., can solve the problems of lack of optimization methods, limited application range and scientific value, lack of versatility, etc., to achieve accurate and fast spatial information, The algorithm is simple and efficient, and the effect of high boundary precision

Active Publication Date: 2019-12-03
SHANGHAI JIAO TONG UNIV
View PDF1 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although many complex high-order energy models provide rich constraints for scene understanding, due to the lack of corresponding optimization methods, they can only be solved by general optimization methods that are not suitable for the model
Another problem is that the current high-order energy models or solution methods lack sufficient generality, which limits its application range and scientific value

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for realizing combined semantic hierarchical connection model based on panoramic area scene perception
  • Method and system for realizing combined semantic hierarchical connection model based on panoramic area scene perception
  • Method and system for realizing combined semantic hierarchical connection model based on panoramic area scene perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Such as figure 1 As shown, it is a multi-level modeling method based on panoramic area scene perception involved in this embodiment, which specifically includes:

[0024] Step 1: Use the multi-scale HOG feature to obtain the underlying feature vector of the region, obtain the salient region according to the two-dimensional hidden Markov model, and then extract the ROI according to the type of scene constituent elements, such as figure 2 shown, including:

[0025] Step 1.1, feature extraction: In order to describe the image block area more comprehensively, the surrounding spatial information is added on the basis of the HOG feature to enhance its context description performance. This feature is called the spatial pyramid HOG feature (SP-HOG, SpatialPyramidHOG).

[0026] Step 1.2, Encoding: Train a feature dictionary according to the feature descriptor of the image, and then use the dictionary for encoding to convert the image into a codeword map.

[0027] The feature ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for realizing a combined semantic hierarchical connection model based on panoramic area scene perception. The system comprises an ROI extraction module, apanoramic region segmentation module, a spatial information acquisition module and a multi-level modeling module; the ROI extraction module is in segmentation connection with a target instance and transmits target salient region information; the panoramic region segmentation module is connected with the interest point 3D reconstruction module and transmits region boundary information; the spatialinformation acquisition module is connected with the semantic subspace model and transmits region position correlation information, and the multi-level modeling module outputs spatial semantics and correlation degree information of each region. On the basis that the ROI is obtained through region significance for panoramic segmentation, on the premise that interest points are extracted for geometric reconstruction and element space semantic information association, multi-level modeling of scene perception is achieved according to analysis of probability symbiosis of scene composition elements.

Description

technical field [0001] The present invention relates to a technology in the field of graphics processing, in particular to a method and system for realizing a combined semantic hierarchical connection model based on panoramic area scene perception. Background technique [0002] In the late 1970s and early 1980s, a complete scene understanding system began to appear, but the existing systems that try to fully understand the visual scene are not self-adaptive, and need to manually set parameters for specific scenes, which cannot be applied to new scene. Although the global energy optimization method based on the high-order Markov model can effectively describe the structural prior of the scene, express the local and global prior of the scene, and effectively integrate multiple scene understanding methods under the same energy optimization framework, but The contradiction between expressiveness and solvability. Although many complex high-order energy models provide rich const...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/32G06N3/04
CPCG06V10/255G06V10/507G06N3/045Y02T10/40
Inventor 万卫兵
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products