Segmentation and semantic annotation method of geometry grid scene model

A scene model and semantic annotation technology, applied in 3D modeling, character and pattern recognition, image data processing and other directions, can solve the problem of less research on scene model segmentation, difficult to achieve 3D scene model retrieval and effective management, not universal, etc. question

Inactive Publication Date: 2013-08-28
BEIJING JIAOTONG UNIV
View PDF5 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The 3D scanning technology is becoming more and more mature. The point cloud data of the 3D scene can be obtained by scanning equipment, and then the geometric grid representation can be obtained through 3D reconstruction for graphics rendering. However, the obtained 3D scene model lacks semantic information, and it is difficult for the computer to Understanding the content in the scene model makes it difficult to achieve content-based retrieval and effective management of the 3D scene model
[0004] From the above analysis, it can be seen that the segmentation of geometric mesh scene models has the following deficiencies: 1) most of the research on geometric mesh model segmentation is aimed at a single object, which is divided into several meaningful sub-components, while the segmentation of scene model There are few studies; 2) The existing methods for detecting and segmenting specific types of objects from the scene cannot be extended to the segmentation of various objects in the scene; 3) The method of using the scene graph to determine the objects in the scene is not universal, and many scene models Does not have a scene graph, or the scene graph is inaccurate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Segmentation and semantic annotation method of geometry grid scene model
  • Segmentation and semantic annotation method of geometry grid scene model
  • Segmentation and semantic annotation method of geometry grid scene model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0036] Example: such as figure 1 As shown, step 1) establishes a 3D model training set, which is a single object, and the training library includes the name of the 3D model, surface shape information in the form of triangular meshes, category label information and feature information.

[0037] The step 1) includes the following sub-steps:

[0038]Step 1.1) Collect an equal number of 3D models of different semantic classes, and record their category labels. These 3D models are required to be a single object, and the representation form is a triangular mesh;

[0039] Step 1.2) Extract the shape features of the triangular mesh model. In the embodiment of the present invention, adopt the method that document Dejan V.Vranic, "DESIRE: a composite3D-shape descriptor."IEEE International Conference on Multimedia and Expo, ICME2005, p962-965. introduce, extract the DESIRE of these triangular mesh models shape features. The DESIRE feature vector is a feature vector composed of three k...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of computer graphics, in particular to a segmentation and semantic annotation method of a geometry grid scene model. The method includes the following steps of building a three-dimensional training set, wherein each three-dimensional model in the training set is required to be a single object; automatically segmenting the scene model, wherein the scene model is segmented into multiple objects according to the training set and on the basis of the clustering hierarchy algorithm; classifying segmentation results, extracting shape characteristics of each object obtained through segmentation, and deciding a class label of the object according to the classification algorithm; collecting the semanteme of the scene model, and collecting the class labels of the objects to obtain a semantic label set of the scene model. Compared with the prior art, the method has the advantages that known shape knowledge in the training set is used in the automatic segmentation method of the scene model for assisting decision making. Therefore, the problem that contact objects are difficult to process during scene segmentation is solved, and semantic annotation of the scene model better fits visual perception of people for scenes.

Description

technical field [0001] The invention relates to the technical field of computer graphics, in particular to a segmentation and semantic labeling method of a geometric grid scene model. Background technique [0002] The 3D scanning technology is becoming more and more mature. The point cloud data of the 3D scene can be obtained by scanning equipment, and then the geometric grid representation can be obtained through 3D reconstruction for graphics rendering. However, the obtained 3D scene model lacks semantic information, and it is difficult for the computer to Understanding the content in the scene model makes it difficult to achieve content-based retrieval and effective management of the 3D scene model. The segmentation and semantic annotation of the 3D scene model is based on scene segmentation, that is, the scene is divided into multiple individual objects, and then the question of what is in the scene is answered, which has positive significance for the content understandi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/30G06K9/62
Inventor 万丽莉
Owner BEIJING JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products